spark on yarn 部署问题

spark on yarn 部署报:java.io.IOException: Resource file:/usr/local/spark-1.6.3-bin-hadoop2.6/lib/spark-assembly-1.6.3-hadoop2.6.0.jar changed on src filesystem (expected 1530607524000, was 1478125561000

解决：spark-env.sh 之前配置

export HADOOP_CONF_DIR=/usr/local/hadoop-2.6.4

export YARN_CONF_DIR=/usr/local/hadoop-2.6.4

发现 HADOOP_CONF_DIR YARN_CONF_DIR 配置路径问题，修改后执行成功如下

export HADOOP_CONF_DIR=/usr/local/hadoop-2.6.4/etc/hadoop

export YARN_CONF_DIR=/usr/local/hadoop-2.6.4/etc/hadoop

spark on yarn 部署问题

2021-10-20
2022-01-31
2021-09-01
2021-07-15
2021-07-30
2021-07-01
2021-04-02