【发布时间】:2018-10-16 04:17:57
【问题描述】:
一段时间以来,我一直用头撞墙。网络上有大量关于 Kubernetes 的信息,但都是假设知识如此丰富,以至于像我这样的 n00bs 并没有太多的事情要做。
那么,任何人都可以分享以下的简单示例(作为 yaml 文件)吗?我想要的只是
- 两个豆荚
- 假设一个 pod 有一个后端(我不知道 - node.js),一个有一个前端(比如 React)。
- 一种在它们之间建立网络的方式。
然后是一个从后往前调用api调用的例子。
我开始研究这类事情,突然间我点击了这个页面 - https://kubernetes.io/docs/concepts/cluster-administration/networking/#how-to-achieve-this。这超级无用。我不想要或不需要高级网络策略,也没有时间浏览映射在 kubernetes 之上的几个不同的服务层。我只是想弄清楚一个网络请求的简单例子。
希望如果这个示例存在于 stackoverflow 上,它也可以为其他人服务。
任何帮助将不胜感激。谢谢。
EDIT; 看起来最简单的例子可能是使用 Ingress 控制器。
编辑编辑;
我正在尝试部署一个最小的示例 - 我将在这里完成一些步骤并指出我的问题。
所以下面是我的yaml 文件:
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: frontend
labels:
app: frontend
spec:
replicas: 3
selector:
matchLabels:
app: frontend
template:
metadata:
labels:
app: frontend
spec:
containers:
- name: nginx
image: patientplatypus/frontend_example
ports:
- containerPort: 3000
---
apiVersion: v1
kind: Service
metadata:
name: frontend
spec:
type: LoadBalancer
selector:
app: frontend
ports:
- protocol: TCP
port: 80
targetPort: 3000
---
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: backend
labels:
app: backend
spec:
replicas: 3
selector:
matchLabels:
app: backend
template:
metadata:
labels:
app: backend
spec:
containers:
- name: nginx
image: patientplatypus/backend_example
ports:
- containerPort: 5000
---
apiVersion: v1
kind: Service
metadata:
name: backend
spec:
type: LoadBalancer
selector:
app: backend
ports:
- protocol: TCP
port: 80
targetPort: 5000
---
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
name: frontend
spec:
rules:
- host: www.kubeplaytime.example
http:
paths:
- path: /
backend:
serviceName: frontend
servicePort: 80
- path: /api
backend:
serviceName: backend
servicePort: 80
我相信这是在做的是
部署前端和后端应用程序 - 我将
patientplatypus/frontend_example和patientplatypus/backend_example部署到 dockerhub,然后将图像拉下来。我的一个悬而未决的问题是,如果我不想从 docker hub 拉取图像,而只想从我的本地主机加载,这可能吗?在这种情况下,我会将我的代码推送到生产服务器,在服务器上构建 docker 镜像,然后上传到 kubernetes。好处是如果我希望我的图像是私有的,我不必依赖 dockerhub。它正在创建两个服务端点,将外部流量从 Web 浏览器路由到每个部署。这些服务的类型为
loadBalancer,因为它们正在平衡我在部署中拥有的(在本例中为 3 个)副本集之间的流量。最后,我有一个入口控制器应该允许我的服务通过
www.kubeplaytime.example和www.kubeplaytime.example/api相互路由。但是这不起作用。
当我运行它时会发生什么?
patientplatypus:~/Documents/kubePlay:09:17:50$kubectl create -f kube-deploy.yaml
deployment.apps "frontend" created
service "frontend" created
deployment.apps "backend" created
service "backend" created
ingress.extensions "frontend" created
-
首先,它似乎可以创建我需要的所有部分,并且没有错误。
patientplatypus:~/Documents/kubePlay:09:22:30$kubectl get --watch servicesNAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGEbackend LoadBalancer 10.0.18.174 <pending> 80:31649/TCP 1mfrontend LoadBalancer 10.0.100.65 <pending> 80:32635/TCP 1mkubernetes ClusterIP 10.0.0.1 <none> 443/TCP 10dfrontend LoadBalancer 10.0.100.65 138.91.126.178 80:32635/TCP 2mbackend LoadBalancer 10.0.18.174 138.91.121.182 80:31649/TCP 2m 其次,如果我查看服务,我最终会获得可用于在浏览器中导航到这些站点的 IP 地址。上述每个 IP 地址分别用于将我路由到前端和后端。
但是
我在尝试使用入口控制器时遇到问题 - 它似乎已部署,但我不知道如何到达那里。
patientplatypus:~/Documents/kubePlay:09:24:44$kubectl get ingresses
NAME HOSTS ADDRESS PORTS AGE
frontend www.kubeplaytime.example 80 16m
- 所以我没有可以使用的地址,
www.kubeplaytime.example似乎也不起作用。
看来我必须做的路由到我刚刚创建的入口扩展是使用it 上的服务和部署来获取 IP 地址,但这开始看起来令人难以置信很快就复杂了。
例如,看看这篇中篇文章:https://medium.com/@cashisclay/kubernetes-ingress-82aa960f658e。
似乎只为到 Ingress 的服务路由添加必要的代码(即他称之为 Ingress Controller)似乎是这样的:
---
kind: Service
apiVersion: v1
metadata:
name: ingress-nginx
spec:
type: LoadBalancer
selector:
app: ingress-nginx
ports:
- name: http
port: 80
targetPort: http
- name: https
port: 443
targetPort: https
---
kind: Deployment
apiVersion: extensions/v1beta1
metadata:
name: ingress-nginx
spec:
replicas: 1
template:
metadata:
labels:
app: ingress-nginx
spec:
terminationGracePeriodSeconds: 60
containers:
- image: gcr.io/google_containers/nginx-ingress-controller:0.8.3
name: ingress-nginx
imagePullPolicy: Always
ports:
- name: http
containerPort: 80
protocol: TCP
- name: https
containerPort: 443
protocol: TCP
livenessProbe:
httpGet:
path: /healthz
port: 10254
scheme: HTTP
initialDelaySeconds: 30
timeoutSeconds: 5
env:
- name: POD_NAME
valueFrom:
fieldRef:
fieldPath: metadata.name
- name: POD_NAMESPACE
valueFrom:
fieldRef:
fieldPath: metadata.namespace
args:
- /nginx-ingress-controller
- --default-backend-service=$(POD_NAMESPACE)/nginx-default-backend
---
kind: Service
apiVersion: v1
metadata:
name: nginx-default-backend
spec:
ports:
- port: 80
targetPort: http
selector:
app: nginx-default-backend
---
kind: Deployment
apiVersion: extensions/v1beta1
metadata:
name: nginx-default-backend
spec:
replicas: 1
template:
metadata:
labels:
app: nginx-default-backend
spec:
terminationGracePeriodSeconds: 60
containers:
- name: default-http-backend
image: gcr.io/google_containers/defaultbackend:1.0
livenessProbe:
httpGet:
path: /healthz
port: 8080
scheme: HTTP
initialDelaySeconds: 30
timeoutSeconds: 5
resources:
limits:
cpu: 10m
memory: 20Mi
requests:
cpu: 10m
memory: 20Mi
ports:
- name: http
containerPort: 8080
protocol: TCP
这似乎需要附加到我上面的其他 yaml 代码中,以便为我的入口路由获取服务入口点,并且它似乎提供了一个 ip:
patientplatypus:~/Documents/kubePlay:09:54:12$kubectl get --watch services
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
backend LoadBalancer 10.0.31.209 <pending> 80:32428/TCP 4m
frontend LoadBalancer 10.0.222.47 <pending> 80:32482/TCP 4m
ingress-nginx LoadBalancer 10.0.28.157 <pending> 80:30573/TCP,443:30802/TCP 4m
kubernetes ClusterIP 10.0.0.1 <none> 443/TCP 10d
nginx-default-backend ClusterIP 10.0.71.121 <none> 80/TCP 4m
frontend LoadBalancer 10.0.222.47 40.121.7.66 80:32482/TCP 5m
ingress-nginx LoadBalancer 10.0.28.157 40.121.6.179 80:30573/TCP,443:30802/TCP 6m
backend LoadBalancer 10.0.31.209 40.117.248.73 80:32428/TCP 7m
所以ingress-nginx 似乎是我想要访问的站点。导航到 40.121.6.179 返回默认的 404 消息 (default backend - 404) - 它不会像 / 那样转到 frontend。 /api 返回相同。导航到我的主机命名空间 www.kubeplaytime.example 从浏览器返回 404 - 没有错误处理。
问题
Ingress Controller 是绝对必要的吗?如果是,有没有更简单的版本?
我觉得我很接近,我做错了什么?
完整的 YAML
可在此处获取:https://gist.github.com/patientplatypus/fa07648339ee6538616cb69282a84938
感谢您的帮助!
编辑编辑编辑
我尝试使用 HELM。从表面上看,它似乎是一个简单的界面,因此我尝试将其旋转起来:
patientplatypus:~/Documents/kubePlay:12:13:00$helm install stable/nginx-ingress
NAME: erstwhile-beetle
LAST DEPLOYED: Sun May 6 12:13:30 2018
NAMESPACE: default
STATUS: DEPLOYED
RESOURCES:
==> v1/ConfigMap
NAME DATA AGE
erstwhile-beetle-nginx-ingress-controller 1 1s
==> v1/Service
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
erstwhile-beetle-nginx-ingress-controller LoadBalancer 10.0.216.38 <pending> 80:31494/TCP,443:32118/TCP 1s
erstwhile-beetle-nginx-ingress-default-backend ClusterIP 10.0.55.224 <none> 80/TCP 1s
==> v1beta1/Deployment
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
erstwhile-beetle-nginx-ingress-controller 1 1 1 0 1s
erstwhile-beetle-nginx-ingress-default-backend 1 1 1 0 1s
==> v1beta1/PodDisruptionBudget
NAME MIN AVAILABLE MAX UNAVAILABLE ALLOWED DISRUPTIONS AGE
erstwhile-beetle-nginx-ingress-controller 1 N/A 0 1s
erstwhile-beetle-nginx-ingress-default-backend 1 N/A 0 1s
==> v1/Pod(related)
NAME READY STATUS RESTARTS AGE
erstwhile-beetle-nginx-ingress-controller-7df9b78b64-24hwz 0/1 ContainerCreating 0 1s
erstwhile-beetle-nginx-ingress-default-backend-849b8df477-gzv8w 0/1 ContainerCreating 0 1s
NOTES:
The nginx-ingress controller has been installed.
It may take a few minutes for the LoadBalancer IP to be available.
You can watch the status by running 'kubectl --namespace default get services -o wide -w erstwhile-beetle-nginx-ingress-controller'
An example Ingress that makes use of the controller:
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
annotations:
kubernetes.io/ingress.class: nginx
name: example
namespace: foo
spec:
rules:
- host: www.example.com
http:
paths:
- backend:
serviceName: exampleService
servicePort: 80
path: /
# This section is only required if TLS is to be enabled for the Ingress
tls:
- hosts:
- www.example.com
secretName: example-tls
If TLS is enabled for the Ingress, a Secret containing the certificate and key must also be provided:
apiVersion: v1
kind: Secret
metadata:
name: example-tls
namespace: foo
data:
tls.crt: <base64 encoded cert>
tls.key: <base64 encoded key>
type: kubernetes.io/tls
看起来这真的很好 - 它使所有内容都旋转起来,并提供了一个如何添加入口的示例。由于我在空白 kubectl 中旋转了 helm,因此我使用以下 yaml 文件添加了我认为需要的内容。
文件:
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: frontend
labels:
app: frontend
spec:
replicas: 3
selector:
matchLabels:
app: frontend
template:
metadata:
labels:
app: frontend
spec:
containers:
- name: nginx
image: patientplatypus/frontend_example
ports:
- containerPort: 3000
---
apiVersion: v1
kind: Service
metadata:
name: frontend
spec:
type: LoadBalancer
selector:
app: frontend
ports:
- protocol: TCP
port: 80
targetPort: 3000
---
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: backend
labels:
app: backend
spec:
replicas: 3
selector:
matchLabels:
app: backend
template:
metadata:
labels:
app: backend
spec:
containers:
- name: nginx
image: patientplatypus/backend_example
ports:
- containerPort: 5000
---
apiVersion: v1
kind: Service
metadata:
name: backend
spec:
type: LoadBalancer
selector:
app: backend
ports:
- protocol: TCP
port: 80
targetPort: 5000
---
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
annotations:
kubernetes.io/ingress.class: nginx
spec:
rules:
- host: www.example.com
http:
paths:
- path: /api
backend:
serviceName: backend
servicePort: 80
- path: /
frontend:
serviceName: frontend
servicePort: 80
将其部署到集群时会遇到此错误:
patientplatypus:~/Documents/kubePlay:11:44:20$kubectl create -f kube-deploy.yaml
deployment.apps "frontend" created
service "frontend" created
deployment.apps "backend" created
service "backend" created
error: error validating "kube-deploy.yaml": error validating data: [ValidationError(Ingress.spec.rules[0].http.paths[1]): unknown field "frontend" in io.k8s.api.extensions.v1beta1.HTTPIngressPath, ValidationError(Ingress.spec.rules[0].http.paths[1]): missing required field "backend" in io.k8s.api.extensions.v1beta1.HTTPIngressPath]; if you choose to ignore these errors, turn validation off with --validate=false
那么,问题就变成了,我该如何调试呢? 如果你吐出 helm 生成的代码,它基本上是一个人无法阅读的 - 没有办法进入那里弄清楚发生了什么。
检查一下:https://gist.github.com/patientplatypus/0e281bf61307f02e16e0091397a1d863 - 超过 1000 行!
如果有人有更好的方法来调试 helm deploy,请将其添加到未决问题列表中。
编辑编辑编辑编辑
为了简化极端,我尝试仅使用命名空间从一个 pod 调用另一个 pod。
所以这是我发出 http 请求的 React 代码:
axios.get('http://backend/test')
.then(response=>{
console.log('return from backend and response: ', response);
})
.catch(error=>{
console.log('return from backend and error: ', error);
})
我也尝试过使用http://backend.exampledeploy.svc.cluster.local/test,但没有运气。
这是我处理 get 的节点代码:
router.get('/test', function(req, res, next) {
res.json({"test":"test"})
});
这是我上传到kubectl 集群的yaml 文件:
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: frontend
namespace: exampledeploy
labels:
app: frontend
spec:
replicas: 3
selector:
matchLabels:
app: frontend
template:
metadata:
labels:
app: frontend
spec:
containers:
- name: nginx
image: patientplatypus/frontend_example
ports:
- containerPort: 3000
---
apiVersion: v1
kind: Service
metadata:
name: frontend
namespace: exampledeploy
spec:
type: LoadBalancer
selector:
app: frontend
ports:
- protocol: TCP
port: 80
targetPort: 3000
---
apiVersion: apps/v1beta1
kind: Deployment
metadata:
name: backend
namespace: exampledeploy
labels:
app: backend
spec:
replicas: 3
selector:
matchLabels:
app: backend
template:
metadata:
labels:
app: backend
spec:
containers:
- name: nginx
image: patientplatypus/backend_example
ports:
- containerPort: 5000
---
apiVersion: v1
kind: Service
metadata:
name: backend
namespace: exampledeploy
spec:
type: LoadBalancer
selector:
app: backend
ports:
- protocol: TCP
port: 80
targetPort: 5000
正如我在终端中看到的那样,上传到集群似乎可以正常工作:
patientplatypus:~/Documents/kubePlay:14:33:20$kubectl get all --namespace=exampledeploy
NAME READY STATUS RESTARTS AGE
pod/backend-584c5c59bc-5wkb4 1/1 Running 0 15m
pod/backend-584c5c59bc-jsr4m 1/1 Running 0 15m
pod/backend-584c5c59bc-txgw5 1/1 Running 0 15m
pod/frontend-647c99cdcf-2mmvn 1/1 Running 0 15m
pod/frontend-647c99cdcf-79sq5 1/1 Running 0 15m
pod/frontend-647c99cdcf-r5bvg 1/1 Running 0 15m
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/backend LoadBalancer 10.0.112.160 168.62.175.155 80:31498/TCP 15m
service/frontend LoadBalancer 10.0.246.212 168.62.37.100 80:31139/TCP 15m
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
deployment.extensions/backend 3 3 3 3 15m
deployment.extensions/frontend 3 3 3 3 15m
NAME DESIRED CURRENT READY AGE
replicaset.extensions/backend-584c5c59bc 3 3 3 15m
replicaset.extensions/frontend-647c99cdcf 3 3 3 15m
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
deployment.apps/backend 3 3 3 3 15m
deployment.apps/frontend 3 3 3 3 15m
NAME DESIRED CURRENT READY AGE
replicaset.apps/backend-584c5c59bc 3 3 3 15m
replicaset.apps/frontend-647c99cdcf 3 3 3 15m
但是,当我尝试发出请求时,我收到以下错误:
return from backend and error:
Error: Network Error
Stack trace:
createError@http://168.62.37.100/static/js/bundle.js:1555:15
handleError@http://168.62.37.100/static/js/bundle.js:1091:14
App.js:14
由于axios 调用是从浏览器发出的,我想知道是否根本不可能使用此方法调用后端,即使后端和前端位于不同的 pod 中。我有点迷茫,因为我认为这是将 pod 联网在一起的最简单方法。
编辑 X5
我已经确定可以通过像这样执行到 pod 中来从命令行卷曲后端:
patientplatypus:~/Documents/kubePlay:15:25:25$kubectl exec -ti frontend-647c99cdcf-5mfz4 --namespace=exampledeploy -- curl -v http://backend/test
* Hostname was NOT found in DNS cache
* Trying 10.0.249.147...
* Connected to backend (10.0.249.147) port 80 (#0)
> GET /test HTTP/1.1
> User-Agent: curl/7.38.0
> Host: backend
> Accept: */*
>
< HTTP/1.1 200 OK
< X-Powered-By: Express
< Content-Type: application/json; charset=utf-8
< Content-Length: 15
< ETag: W/"f-SzkCEKs7NV6rxiz4/VbpzPnLKEM"
< Date: Sun, 06 May 2018 20:25:49 GMT
< Connection: keep-alive
<
* Connection #0 to host backend left intact
{"test":"test"}
毫无疑问,这意味着,因为前端代码正在浏览器中执行,它需要 Ingress 才能进入 Pod,因为来自前端的 http 请求破坏了简单的 Pod 网络。我不确定这一点,但这意味着 Ingress 是必要的。
【问题讨论】:
标签: networking deployment kubernetes containers web-deployment