stackdriver-metadata-agent-cluster-level 很多失败与 [2a00:1450:400c:c09::5f]:443: i/o timeout

Question

我在 europe-west1-d 区域有 k8s 和 1.14.10-gke.27。

在过去的几天里，我在 kube-system ns 中有很多 stackdriver-metadata-agent-cluster-level pod 重新启动并出现错误

I0402 16:39:12.688053       1 main.go:142] All resources are being watched, agent has started successfully
I0402 16:39:12.688108       1 main.go:145] No statusz port provided; not starting a server
I0402 16:39:29.383562       1 retry.go:80] call failed with err=rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp [2a00:1450:400c:c09::5f]:443: i/o timeout", retrying.
I0402 16:39:29.383667       1 retry.go:80] call failed with err=rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp [2a00:1450:400c:c09::5f]:443: i/o timeout", retrying.
I0402 16:39:30.483072       1 retry.go:80] call failed with err=rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp [2a00:1450:400c:c09::5f]:443: i/o timeout", retrying.
I0402 16:39:30.783091       1 retry.go:80] call failed with err=rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp [2a00:1450:400c:c09::5f]:443: i/o timeout", retrying.
I0402 16:40:09.186357       1 binarylog.go:265] rpc: flushed binary log to ""
I0402 16:41:29.383025       1 binarylog.go:265] rpc: flushed binary log to ""

logs screenshot

这是谷歌网络问题吗？

Answer 1

我将其添加为答案，因为如果我将其放入 cmets 中，有很多代码将完全不可读。一旦我们设法找出解决方案，我将对其进行编辑。

您能否运行这些 Stackdriver 日志查询并将输出作为代码示例发布在您的问题中（使用 ctrl+k 在所选文本上）？

resource.type="k8s_container"
resource.labels.project_id="<project_id>"
resource.labels.location="<location e.g. us-central1-c>"
resource.labels.cluster_name="<cluster-name>"
resource.labels.namespace_name="kube-system"
labels.k8s-pod/app="stackdriver-metadata-agent"
labels.k8s-pod/cluster-level="true"
"oom"

resource.type="k8s_container"
resource.labels.project_id="<project-id>"
resource.labels.location="<location e.g. us-central1-c>"
resource.labels.cluster_name="<cluster-name>"
resource.labels.namespace_name="kube-system"
labels.k8s-pod/app="stackdriver-metadata-agent"
labels.k8s-pod/cluster-level="true"
severity>=WARNING
sourceLocation.file!="reflector.go"

请不要把它当成截图，因为它在搜索时非常无用。