Kubernetes 中有状态的 jupyter 笔记本

Question

尝试在 Kubernetes 中部署有状态的 jupyter notebook，但无法保存在 notebook 中编写的代码，每当 notebook pod 关闭时，所有代码都会被删除。我尝试使用持久音量，但无法达到预期效果。

更新

将挂载路径更改为“/home/jovyan”，因为 jyputer 将 ipynb 保存在此位置。但是现在在部署 Pod 时出现 PermissionError: [Errno 13] Permission denied: '/home/jovyan/.local'。

kind: Ingress
metadata:
  name: jupyter-ingress
spec:
  backend:
    serviceName: jupyter-notebook-service
    servicePort: 8888

---

kind: Service
apiVersion: v1
metadata:
  name: jupyter-notebook-service
spec:  
  clusterIP: None
  selector:
    app: jupyter-notebook
  ports:
  - protocol: TCP    
    port: 8888
    targetPort: 8888

---

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: jupyter-notebook
  labels:
    app: jupyter-notebook
spec:
  replicas: 1
  serviceName: "jupyter-notebook-service"
  selector:
    matchLabels:
      app: jupyter-notebook
  template:
    metadata:
      labels:
        app: jupyter-notebook
    spec:
      serviceAccountName: dsx-spark
      volumes:
        - name: jupyter-pv-storage
          persistentVolumeClaim:
            claimName: jupyter-pv-claim 
      containers:
      - name: minimal-notebook
        image: jupyter/pyspark-notebook:latest
        ports:
        - containerPort: 8888
        command: ["start-notebook.sh"]
        args: ["--NotebookApp.token=''"]
        volumeMounts:
          - mountPath: "/home/jovyan"
            name: jupyter-pv-storage

---

kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: jupyter-pv-claim
spec:
  storageClassName: jupyter-pv-storage
  accessModes:
  - ReadWriteOnce 
  resources:
    requests:
      storage: 1Gi

---
---

apiVersion: v1
kind: PersistentVolume
metadata:
  name: jupyter-pv-volume
  labels:
    type: local
spec:
  storageClassName: jupyter-pv-storage
  capacity:
    storage: 1Gi
  accessModes:
    - ReadWriteOnce 
  hostPath:
    path: "/home/jovyan"

---

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: jupyternotebook-pv-storage
  annotations:
    storageclass.kubernetes.io/is-default-class: "true"
  labels:
provisioner: kubernetes.io/vsphere-volume
parameters:
    diskformat: zeroedthick
    ```

Answer 1

带有 jupyter notebook 的 Pod 是非 root 用户，所以无法挂载，所以我们是 在创建 Pod 之前使用 initContainers 更改 Persistent Volume Claim 的用户/权限。

kind: StatefulSet
metadata:
  name: jupyter-notebook
  labels:
    app: jupyter-notebook
spec:
  replicas: 1
  serviceName: "jupyter-notebook-service"
  selector:
    matchLabels:
      app: jupyter-notebook
  template:
    metadata:
      labels:
        app: jupyter-notebook
    spec:

      serviceAccountName: dsx-spark
      volumes:
        - name: ci-jupyter-storage-def
          persistentVolumeClaim:
            claimName: my-jupyter-pv-claim 
      containers:
      - name: minimal-notebook
        image: jupyter/pyspark-notebook:latest
        ports:
        - containerPort: 8888
        command: ["start-notebook.sh"]
        args: ["--NotebookApp.token=''"]
        volumeMounts:
          - mountPath: "/home/jovyan/work"
            name: ci-jupyter-storage-def

      initContainers:
      - name: jupyter-data-permission-fix
        image: busybox
        command: ["/bin/chmod","-R","777", "/data"]
        volumeMounts:
        - name: ci-jupyter-storage-def
          mountPath: /data```

Answer 2

正如我在 cmets 中已经提到的，您需要确保：

1. 给定 Pod 的存储必须由 PersistentVolume Provisioner 基于请求的存储类进行配置，或者由管理员预先配置。 volumeClaimTemplates 将使用 PersistentVolumes 提供 stable storage。当 Pod 或 StatefulSet 被删除时，与 Pod 的 PersistentVolume 声明关联的 PersistentVolume 不会被删除。

2. 容器正在以有权访问该卷的用户身份运行。可以通过将权限更改为 777 或使用适当的 initContainers 来完成。