【问题标题】:Dataflow worker subnetwork is not accessible to Dataflow Service accountDataflow 服务帐户无法访问 Dataflow 工作子网
【发布时间】:2018-05-13 04:58:12
【问题描述】:

当我在 Dataflow 上运行作业时,出现错误。

INFO: 2018-05-13T04:43:38.642Z: Checking required Cloud APIs are enabled.
May 13, 2018 11:44:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-13T04:43:38.927Z: Checking permissions granted to controller Service Account.
May 13, 2018 11:44:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-05-13T04:43:51.378Z: Workflow failed. Causes: Subnetwork regions/asia-southeast1/subnetworks/SUBNETWORK is not accessible to Dataflow Service account
May 13, 2018 11:44:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-13T04:43:53.038Z: Cleaning up.

我的命令行

mvn compile -X exec:java -Dexec.mainClass=com.to.class \
"-Dexec.args=--runner=DataflowRunner \
...
--network=NETWORKNAME \
--subnetwork=regions/asia-southeast1/subnetworks/SUBNETWORK \
--zone=asia-east1-a \
--region=asia-east1 \
" -Pdataflow-runner

【问题讨论】:

    标签: google-cloud-platform google-cloud-dataflow


    【解决方案1】:

    子网位于asia-southeast1 区域,而工作人员位于asia-east1。您可以使用asia-east1 中的子网或在asia-southeast1 区域之一中配置VM,但两者都需要匹配。对于后一种方法,请考虑到 asia-southeast1 不是 supported regional endpoint ,因此您不能使用 --region 标志来指定它以用于控制和元数据目的(但是您可以使用 @987654328 启动工作人员@标志)。

    【讨论】:

      猜你喜欢
      • 2018-12-24
      • 2019-05-06
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2016-06-19
      相关资源
      最近更新 更多