【问题标题】:Can't run a pig script on apache Zeppelin无法在 apache Zeppelin 上运行 pig 脚本
【发布时间】:2018-12-20 05:59:24
【问题描述】:
> org.apache.pig.backend.executionengine.ExecException: ERROR 4010:
> Cannot find hadoop configurations in classpath (neither
> hadoop-site.xml nor core-site.xml was found in the classpath). If you
> plan to use local mode, please put -x local option in command line at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.getExecConf(HExecutionEngine.java:157)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:194)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:111)
> at org.apache.pig.impl.PigContext.connect(PigContext.java:310) at
> org.apache.pig.PigServer.<init>(PigServer.java:232) at
> org.apache.pig.PigServer.<init>(PigServer.java:220) at
> org.apache.pig.PigServer.<init>(PigServer.java:193) at
> org.apache.pig.PigServer.<init>(PigServer.java:185) at
> org.apache.zeppelin.pig.PigInterpreter.open(PigInterpreter.java:61) at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:188) at
> org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)

我尝试在 apache Zeppelin 上运行 pig 脚本,但它给了我这个错误。我检查了所有配置和设置,但无法解决这个问题。

【问题讨论】:

  • 您检查了哪些配置以及在哪里检查? HADOOP_CONF_DIR 环境变量中有哪些文件?您能否在问题中显示您的 Pig 配置属性?你可以在 Zeppelin 之外运行 Pig shell 吗?

标签: java hadoop apache-pig apache-zeppelin


【解决方案1】:

请在此处查看文档。 https://zeppelin.apache.org/docs/0.8.0/interpreter/pig.html 很可能您将执行模式设置为 mapreduce,但没有配置 HADOOP_CONF_DIR

【讨论】:

  • 感谢您的关注。问题已解决。
猜你喜欢
  • 2015-11-10
  • 2020-03-05
  • 1970-01-01
  • 2017-03-11
  • 2016-11-21
  • 2013-07-29
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
相关资源
最近更新 更多