【问题标题】:cloudera vm hadoop Hive fails after fs.http.address ip changedfs.http.address ip 更改后 cloudera vm hadoop Hive 失败
【发布时间】:2011-11-30 14:31:08
【问题描述】:

我使用 Cloudera VM (cdh3u2) 作为模拟分布式文件系统。为了从 Web 服务器执行文件创建和写入,我将 fs.http.address 属性更改为指向 VM IP。此功能运行良好。 当 HIVE 执行 map reduce 工作时会出现问题,例如

SELECT COUNT(*) FROM tmp2;

我得到的信息是:

hive> select count(*) from tmp2;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201111301538_0001, Tracking URL = http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201111301538_0001
Kill Command = /usr/lib/hadoop/bin/hadoop job  -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201111301538_0001
2011-11-30 16:01:21,773 Stage-1 map = 0%,  reduce = 0%
2011-11-30 16:01:43,064 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201111301538_0001 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask

Hive 执行以下 SQL(不需要 map reduce 作业)没有问题:

SHOW TABLES;
SELECT * FROM tmp2;

【问题讨论】:

    标签: hadoop mapreduce hive cloudera


    【解决方案1】:

    Hive 不响应 IP。更改为 dns 名称

    【讨论】:

      猜你喜欢
      • 2018-09-06
      • 2014-02-12
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2021-11-12
      相关资源
      最近更新 更多