【发布时间】:2018-05-26 12:09:23
【问题描述】:
看之前:
RuntimeError: IOError: [Errno 2] No such file or directory:
'/beam-temp-andrew_mini_vocab-..../......andrew_mini_vocab' [while running .....]
在我的 apache beam python 数据流作业中,我看到记录了这个错误:
A setup error was detected in __. Please refer to the worker-startup
log for detailed information. `
我找到了worker启动日志,Payload错误是:
Failed to install packages: failed to install SDK: exit status 2
该错误不够具体,我无法调试。对未加载哪些 SDK 有任何见解吗?我的工作导入非常基础:
from __future__ import absolute_import
from __future__ import division
import argparse
import logging
import re
import apache_beam as beam
from apache_beam.io import WriteToText
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.options.pipeline_options import SetupOptions
from apache_beam.pvalue import AsDict
【问题讨论】:
-
您是如何安装梁的?只是通过点子?
-
我遇到了子进程的退出状态 2,它通过将 pip 更新到大于 7 的版本来解决,原因是在该版本之前不支持
no-binary选项,该版本在 apache beam 的 python sdk 中使用 -
@Andrew Cassidy - Anuj 的回答有帮助吗?
标签: python python-2.7 google-cloud-platform google-cloud-dataflow apache-beam