数据流作业因无法在梁 2.14 中找到 ext4 文件系统而挂起答案

【问题标题】：Dataflow job hang by Can't find ext4 filesystem in beam 2.14数据流作业因无法在梁 2.14 中找到 ext4 文件系统而挂起
【发布时间】：2019-08-27 16:27:42
【问题描述】：

我的数据流作业挂起，我发现错误如下

2019-08-27 22:09:42.030 HKT
EXT4-fs (sdb): VFS: Can't find ext4 filesystem
Expand all | Collapse all {
 insertId:  "s=be15be46dadc4bf6b53cb72a83412a3f;i=4b3;b=655c37b5c26541178d67bd3a584d0256;m=1b4b156;t=59119d2e5aba9;x=c15bd8bf26ae8753"  
 jsonPayload: {…}  
 labels: {…}  
 logName:  "projects/projectname/logs/dataflow.googleapis.com%2Fsystem"  
 receiveTimestamp:  "2019-08-27T14:09:49.701365316Z"  
 resource: {…}  
 severity:  "ERROR"  
 timestamp:  "2019-08-27T14:09:42.030249Z"  
}

和其他警告

W 2019-08-27T14:09:16.285720Z [/usr/lib/tmpfiles.d/var.conf:12] Duplicate line for path "/var/run", ignoring. 
W 2019-08-27T14:09:16.299244Z Cannot set file attribute for '/var/log/journal', value=0x00800000, mask=0x00800000: Operation not supported 
W 2019-08-27T14:09:16.299660Z Cannot set file attribute for '/var/log/journal/32ffce3c053bcc2b3d6585166bd050d1', value=0x00800000, mask=0x00800000: Operation not supported 
W 2019-08-27T14:09:19.332660Z Could not load the device policy file. 
W 2019-08-27T14:09:22.434563Z [WARNING:persistent_integer.cc(96)] cannot open /var/lib/metrics/version.cycle for reading: No such file or directory 
W 2019-08-27T14:09:28.609260Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420 
W 2019-08-27T14:09:28.610011Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420 
W 2019-08-27T14:09:28.610490Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420

即使将 beam 升级到 2.15.0，这个问题仍然存在。

更新

当我在另一个 GCP 项目中运行相同的代码时，管道可以正常工作...

【问题讨论】：

标签： python google-cloud-dataflow apache-beam

【解决方案1】：

看起来像 GCE 问题。您可能需要联系Google Cloud Support。

【讨论】：