【发布时间】:2021-08-15 16:06:29
【问题描述】:
** 我想构建一个火花流式 kafka 应用程序,它将使用来自 kafka 主题的数据。但是当我执行 sbt run 时,没有问题,即使是 sbt 包但没有创建 jar 文件。有人能帮我吗?我正在使用 IntelliJ IDE **
this is my build.sbt
`name := "untitled4"
version := "0.1"
scalaVersion := "2.12.10"
autoScalaLibrary := false
// https://mvnrepository.com/artifact/org.apache.spark/spark-streaming
libraryDependencies += "org.apache.spark" %% "spark-streaming" % "3.0.2"
// https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-kafka-0-10
libraryDependencies += "org.apache.spark" %% "spark-streaming-kafka-0-10" % "3.0.2"
// https://mvnrepository.com/artifact/org.apache.spark/spark-core
libraryDependencies += "org.apache.spark" %% "spark-core" % "3.0.2"
// https://mvnrepository.com/artifact/org.apache.spark/spark-sql
libraryDependencies += "org.apache.spark" %% "spark-sql" % "3.0.2
当我运行 sbt package 时: 这是 sbt 包的输出。
C:\Users\IdeaProjects\untitled4>sbt package
[info] welcome to sbt 1.4.7 (Oracle Corporation Java 1.8.0_281)
[info] loading global plugins from C:\.sbt\1.0\plugins
[info] loading project definition from C:\Users\IdeaProjects\untitled4\project
[info] loading settings for project untitled4 from build.sbt ...
[info] set current project to untitled4 (in build file:/C:/Users/IdeaProjects/untitled4/)
[success] Total time: 1 s, completed 27 mai 2021 11:21:41
【问题讨论】:
标签: scala apache-spark sbt