spark-cassandra-connector 2.0.2 的 sbt 未解决依赖关系

Question

build.sbt:

val sparkVersion = "2.1.1";

libraryDependencies += "org.apache.spark" %% "spark-core" % sparkVersion % "provided";
libraryDependencies += "org.apache.spark" %% "spark-sql" % sparkVersion % "provided";
libraryDependencies += "org.apache.spark" %% "spark-streaming" % sparkVersion % "provided";

libraryDependencies += "com.datastax.spark" % "spark-cassandra-connector" % "2.0.2";
libraryDependencies += "org.apache.spark" % "spark-streaming-kafka-0-10_2.11" % sparkVersion;

输出：

[error] (myproject/*:update) sbt.ResolveException: unresolved dependency: com.datastax.spark#spark-cassandra-connector;2.0.2: not found

有什么想法吗？我是 sbt 和 spark 的新手。谢谢

Answer 1

这是由 "com.datastax.spark" % "spark-cassandra-connector" % "2.0.2"; 没有 scala 版本引起的，请参阅 ma​​ven repo：

http://search.maven.org/#artifactdetails%7Ccom.datastax.spark%7Cspark-cassandra-connector_2.11%7C2.0.2%7Cjar

有两种解决方案：

1. "com.datastax.spark" % "spark-cassandra-connector_2.11" % "2.0.2" 显式设置 Scala 版本 为依赖项
2. "com.datastax.spark" %% "spark-cassandra-connector" % "2.0.2"，使用带有 artifact id 的 %%，这样，SBT 将自动基于您项目的 scala 版本 扩展到解决方案 1。