Spark Notebook 不适用于 EMR 的 HUE答案

【问题标题】：Spark Notebook not working on HUE for EMRSpark Notebook 不适用于 EMR 的 HUE
【发布时间】：2015-08-07 09:41:03
【问题描述】：

好的，我的 EMR 集群指向了 hue 3.8，它大部分都在工作。我现在真正关心的一件事是火花笔记本

当我尝试为 sn-p 选择一种语言时，出现错误“No usable value for lang Did not find value which can be converted into java.lang.String (error 400)”并且日志显示如下：

[03/Jun/2015 11:38:59 -0700] decorators   ERROR    error running <function create_session at 0x7fe30acd1d70>
Traceback (most recent call last):
  File "/usr/local/hue/apps/spark/src/spark/decorators.py", line 77, in decorator
    return func(*args, **kwargs)
  File "/usr/local/hue/apps/spark/src/spark/api.py", line 44, in create_session
    response['session'] = get_api(request.user, snippet).create_session(lang=snippet['type'])
  File "/usr/local/hue/apps/spark/src/spark/models.py", line 284, in create_session
    response = api.create_session(kind=lang)
  File "/usr/local/hue/apps/spark/src/spark/job_server_api.py", line 87, in create_session
    return self._root.post('sessions', data=json.dumps(kwargs), contenttype='application/json')
  File "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in post
    return self.invoke("POST", relpath, params, data, self._make_headers(contenttype, headers))
  File "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 78, in invoke
    urlencode=self._urlencode)
  File "/usr/local/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 161, in execute
    raise self._exc_class(ex)
RestException: No usable value for lang
Did not find value which can be converted into java.lang.String (error 400)

这是软件问题还是我的配置问题？

这可能与尝试运行 sudo ./hue livy_server 会产生以下事实有关：

Failed to run spark-submit executable: java.io.IOException: 
  Cannot run program "spark-submit": error=2, No such file or directory

spark-submit 实际上存在并且在路径中

【问题讨论】：

标签： apache-spark hue

【解决方案1】：

火花提交

命令来自 Spark，它需要存在于 Hue 机器上。

【讨论】：