【问题标题】:Unable to load native-hadoop library for your platform...Snappy native library not loaded无法为您的平台加载 native-hadoop 库...未加载 Snappy 本机库
【发布时间】:2013-09-10 12:10:21
【问题描述】:

当我通过 cygwin 在 hadoop 上运行此命令时:

$bin/hadoop jar hadoop-examples-*.jar grep input output 'dfs[a-z.]+'

我收到以下错误:

13/09/06 17:06:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/09/06 17:06:04 WARN snappy.LoadSnappy: Snappy native library not loaded
13/09/06 17:06:05 INFO mapred.FileInputFormat: Total input paths to process : 18
13/09/06 17:06:05 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:9000/tmp/hadoop-cyg_server/mapred/staging/cyg_server/.staging/job_201309061646_0003
13/09/06 17:06:05 ERROR security.UserGroupInformation: PriviledgedActionException as:cyg_server cause:java.io.IOException: Not a file: hdfs://localhost:9000/user/cyg_server/input/conf
java.io.IOException: Not a file: hdfs://localhost:9000/user/cyg_server/input/conf
        at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:215)
        at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:1081)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1073)
        at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353)
        at org.apache.hadoop.examples.Grep.run(Grep.java:69)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.examples.Grep.main(Grep.java:93)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:491)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:491)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:160)

请告诉我“无法为您的平台加载 native-hadoop 库...Snappy 本地库未加载”的解决方案

【问题讨论】:

  • 这几行代码是什么?在不知道你的代码是什么、你的程序是什么、你的输入是什么等的情况下,我需要一个水晶球来弄清楚。

标签: java apache hadoop localhost


【解决方案1】:

http://hadoop.apache.org/docs/stable/native_libraries.html

“本机 hadoop 库仅在 *nix 平台上受支持。该库不适用于 Cygwin 或 Mac OS X 平台。”

【讨论】:

  • 这不是正确的答案,先生。萨瓦亚
猜你喜欢
  • 1970-01-01
  • 2013-11-25
  • 2021-12-11
  • 2015-08-02
  • 1970-01-01
  • 1970-01-01
  • 2016-02-28
  • 1970-01-01
  • 1970-01-01
相关资源
最近更新 更多