无法解析 org.apache.hadoop:hadoop-aws:2.7.6 的依赖关系

Question

当我输入以下命令让我的 java spark 从 amazon s3 读取 csv 文件时

spark-submit --class myApp --packages org.apache.hadoop:hadoop-aws:2.7.6 --master local ./target/spark_pratice.jar

错误信息

                ::::::::::::::::::::::::::::::::::::::::::::::

                ::              FAILED DOWNLOADS            ::

                :: ^ see resolution messages for details  ^ ::

                ::::::::::::::::::::::::::::::::::::::::::::::

                :: javax.activation#activation;1.1!activation.jar

                :: asm#asm;3.2!asm.jar

                :: org.apache.avro#avro;1.7.4!avro.jar

                :: com.thoughtworks.paranamer#paranamer;2.3!paranamer.jar

                :: org.xerial.snappy#snappy-java;1.0.4.1!snappy-java.jar(bundle)

                :: io.netty#netty;3.6.2.Final!netty.jar(bundle)

                ::::::::::::::::::::::::::::::::::::::::::::::
:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [
    download failed: javax.activation#activation;1.1!activation.jar, 
    download failed: asm#asm;3.2!asm.jar, 
    download failed: org.apache.avro#avro;1.7.4!avro.jar, 
    download failed: com.thoughtworks.paranamer#paranamer;2.3!paranamer.jar, 
    download failed: org.xerial.snappy#snappy-java;1.0.4.1!snappy-java.jar(bundle), 
    download failed: io.netty#netty;3.6.2.Final!netty.jar(bundle)
]

我不知道如何解决这个问题。 我应该更新什么吗？行家？或者是其他东西 ？

Answer 1

最后我尝试从maven仓库maven repository下载丢失的jar文件

我将它们放入正确的 .m2/repository 存储库中

Answer 2

我遇到了同样的问题，我删除了.ivy2/cache、ivy2/jars 和.m2/repository/ 目录并执行了spark-shell --package 命令，它开始工作了。