【问题标题】:Vora 1.3 Thriftserver cannot startVora 1.3 Thriftserver 无法启动
【发布时间】:2017-01-22 23:24:50
【问题描述】:

我正在使用 Manager Web UI 在 HDP 2.3 上部署 Vora 1.3 服务。主要是默认配置和节点分配。我已将 Vora Thriftserver 服务分配给已成功托管 Vora 1.2 相同服务的节点(我已将其删除)。

服务没有启动。这是日志的相关部分:

17/01/23 10:04:27 INFO Server: jetty-8.y.z-SNAPSHOT
17/01/23 10:04:27 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
17/01/23 10:04:27 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/01/23 10:04:27 INFO SparkUI: Started SparkUI at http://<jumpbox>:4040
17/01/23 10:04:28 INFO SparkContext: Added JAR file:/var/lib/ambari-agent/cache/stacks/HDP/2.3/services/vora-manager/package/lib/vora-spark/lib/spark-sap-datasources-1.3.102-assembly.jar at http://<jumpbox>:41874/jars/spark-sap-datasources-1.3.102-assembly.jar with timestamp 1485126268263
17/01/23 10:04:28 WARN MetricsSystem: Using default name DAGScheduler for source because spark.app.id is not set.
17/01/23 10:04:28 INFO Executor: Starting executor ID driver on host localhost
17/01/23 10:04:28 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 37523.
17/01/23 10:04:28 INFO NettyBlockTransferService: Server created on 37523
17/01/23 10:04:28 INFO BlockManagerMaster: Trying to register BlockManager
17/01/23 10:04:28 INFO BlockManagerMasterEndpoint: Registering block manager localhost:37523 with 530.0 MB RAM, BlockManagerId(driver, localhost, 37523)
17/01/23 10:04:28 INFO BlockManagerMaster: Registered BlockManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/execution/SparkPlanner
        at org.apache.spark.sql.hive.sap.thriftserver.SapSQLEnv$.init(SapSQLEnv.scala:39)
        at org.apache.spark.sql.hive.thriftserver.SapThriftServer$.main(SapThriftServer.scala:22)
        at org.apache.spark.sql.hive.thriftserver.SapThriftServer.main(SapThriftServer.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
(.... goes on...)

Vora Thriftserver 配置选项卡中的 Spark 可执行文件和 Java 可执行文件路径正确。

我错过了什么吗?

【问题讨论】:

    标签: vora


    【解决方案1】:

    您正在运行 Vora 1.3,这意味着您必须使用 HDP 2.4.2,其中包括所需的 Spark 1.6.1 版本。见Vora官方product availability matrix (PAM)

    【讨论】:

    • 谢谢迪米特里! SAP 内部是否对 Vora 和 NLS 的 Hadoop 版本要求进行了协调?我的意思是,如果我想升级我的 HDP 以适应 Vora,我是否能够对 NLS 使用相同的安装 - Note 2363218 中的必备版本看起来非常旧。
    猜你喜欢
    • 1970-01-01
    • 2015-01-28
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多