【问题标题】:How can I configure different storage mount for different pod in Elasticsearch cluster in K8S?如何在 K8S 的 Elasticsearch 集群中为不同的 Pod 配置不同的存储挂载?
【发布时间】:2021-11-14 18:23:14
【问题描述】:

我正在使用节点组将 Elasticsearch 集群部署到 EKS 上的 K8S。我为集群的存储申请了 EBS。当我启动集群时,只有一个 pod 成功运行,但其他 pod 出现此错误:

 Warning  FailedAttachVolume  3m33s                  attachdetach-controller  Multi-Attach error for volume "pvc-4870bd46-2f1e-402a-acf7-005de83e4588" Volume is already used by pod(s) es-0
  Warning  FailedMount         90s                    kubelet                  Unable to attach or mount volumes: unmounted volumes=[persistent-storage], unattached volumes=[es-config persistent-storage default-token-pqzkp]: timed out waiting for the condition

这意味着存储已在使用中。我了解此卷由第一个 pod 使用,因此其他 pod 无法使用它。但是我不知道在使用相同的 EBS 卷时如何为不同的 pod 使用不同的挂载路径。

以下是集群的完整规范。


apiVersion: v1
kind: ConfigMap
metadata:
  name: es-config
data:
  elasticsearch.yml: |
    cluster.name: elk-cluster
    network.host: "0.0.0.0"
    bootstrap.memory_lock: false
    # discovery.zen.minimum_master_nodes: 2
    node.max_local_storage_nodes: 9
    discovery.seed_hosts:
      - es-0.es-entrypoint.default.svc.cluster.local
      - es-1.es-entrypoint.default.svc.cluster.local
      - es-2.es-entrypoint.default.svc.cluster.local
  ES_JAVA_OPTS: -Xms4g -Xmx8g
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es
  namespace: default
spec:
  serviceName: es-entrypoint
  replicas: 3
  selector:
    matchLabels:
      name: es
  template:
    metadata:
      labels:
        name: es
    spec:
      volumes:
        - name: es-config
          configMap:
            name: es-config
            items:
              - key: elasticsearch.yml
                path: elasticsearch.yml
        - name: persistent-storage
          persistentVolumeClaim:
            claimName: ebs-claim
      initContainers:
        - name: permissions-fix
          image: busybox
          volumeMounts:
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
          command: [ 'chown' ]
          args: [ '1000:1000', '/usr/share/elasticsearch/data' ]
      containers:
        - name: es
          image: elasticsearch:7.10.1
          resources:
            requests:
              cpu: 2
              memory: 8Gi
          ports:
            - name: http
              containerPort: 9200
            - containerPort: 9300
              name: inter-node
          volumeMounts:
            - name: es-config
              mountPath: /usr/share/elasticsearch/config/elasticsearch.yml
              subPath: elasticsearch.yml
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
---
apiVersion: v1
kind: Service
metadata:
  name: es-entrypoint
spec:
  selector:
    name: es
  ports:
    - port: 9200
      targetPort: 9200
      protocol: TCP
  clusterIP: None

【问题讨论】:

    标签: elasticsearch kubernetes amazon-eks


    【解决方案1】:

    您应该将 volumeClaimTemplates 与 statefulset 一起使用,以便每个 pod 都有自己的卷。 Details:

    volumeClaimTemplates:
    - metadata:
        name: es
      spec:
        accessModes:
        - ReadWriteOnce
        resources:
          requests:
            storage: 5Gi
        # storageClassName: <omit to use default StorageClass or specify>
    

    【讨论】:

    • 我尝试了您的解决方案,它有效。但是当我运行kubectl delete -f pod.yml 时,pvc 并没有被删除。
    • Statefulset 创建的 PVC 不会被自动删除。
    猜你喜欢
    • 1970-01-01
    • 2021-01-16
    • 1970-01-01
    • 2022-08-10
    • 1970-01-01
    • 1970-01-01
    • 2022-06-10
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多