【问题标题】:Do not see any running application on sever UI在服务器 UI 上看不到任何正在运行的应用程序
【发布时间】:2017-08-21 12:15:27
【问题描述】:

感谢本地的 SparklyR,我正在尝试连接到我的 Spark 服务器。 实际上,在我的服务器上,我打开一个 R 会话并执行

library(sparklyr)
library(dplyr)
sc <- spark_connect(master = "local")

我没有收到错误消息,但是当我在

上打开服务器 UI 时

http://my.server.local:8080/

我没有看到任何正在运行的应用程序。所以我猜有问题?

当我直接打开 SparkR 控制台时,我能够看到正在运行的应用程序。 我真的很想与 SparklyR 合作,我该怎么做?

【问题讨论】:

  • 您尝试了端口 8081、7077 还是 4040 吗?

标签: r apache-spark sparklyr


【解决方案1】:

启动本地服务器时,例如:

Fokkos-MacBook-Pro:~ fokkodriesprong$ sparkR

R version 3.4.1 (2017-06-30) -- "Single Candle"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin16.7.0 (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

  Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

Launching java with spark-submit command /usr/local/Cellar/apache-spark/2.2.0/libexec/bin/spark-submit   "sparkr-shell" /var/folders/dm/5qvjnrpx4m92318vwt4svfsh0000gn/T//Rtmpgtr1tn/backend_port1227e57d8a425 
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/08/21 15:16:09 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/08/21 15:16:13 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException

 Welcome to
    ____              __ 
   / __/__  ___ _____/ /__ 
  _\ \/ _ \/ _ `/ __/  '_/ 
 /___/ .__/\_,_/_/ /_/\_\   version  2.2.0 
    /_/ 


 SparkSession available as 'spark'.
During startup - Warning messages:
1: Setting LC_COLLATE failed, using "C" 
2: Setting LC_TIME failed, using "C" 
3: Setting LC_MESSAGES failed, using "C" 
4: Setting LC_MONETARY failed, using "C" 
> 

那么 Spark UI 应该可以在 http://localhost:4040/ 获得

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 2013-01-24
    • 1970-01-01
    • 1970-01-01
    • 2020-06-12
    • 1970-01-01
    • 2017-10-20
    • 1970-01-01
    • 2011-05-13
    相关资源
    最近更新 更多