【问题标题】:Spark: Association with remote system failed. Reason: DisassociatedSpark:与远程系统的关联失败。原因:解除关联
【发布时间】:2017-02-17 18:07:48
【问题描述】:

我有一个独立的火花作业,每次作业完成时,都会出现以下警告:我不太明白这个的含义以及如何解决这个问题。如果你能帮忙就太好了。谢谢

 WARN  [SparkWorker-0 error logger] 2016-10-08 10:18:33,395 SparkWorker-0 ExternalLogger.java:92 
- Association with remote system [akka.tcp://sparkExecutor@10.47.183.30:39422] has failed, address is now gated for [5000] ms. Reason is: [Disassociated].
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,406  Logging.scala:59 - Removing executor app-20161008101807-0002/5 because it is EXITED
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,407  Logging.scala:59 - Launching executor app-20161008101807-0002/6 on worker worker-20161008093556-10.47.183.121-41649
    WARN  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,762  Logging.scala:71 - Got status update for unknown executor app-20161008100608-0001/4
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,819  Logging.scala:59 - akka.tcp://sparkDriver@XXX.196.201.23:36340 got disassociated, removing it.
    INFO  [SparkWorker-0 logger] 2016-10-08 10:18:33,835 SparkWorker-0 ExternalLogger.java:88 - Executor app-20161008100608-0001/0 finished with state KILLED exitStatus 143
    WARN  [sparkMaster-akka.actor.default-dispatcher-5] 2016-10-08 10:18:33,837  Logging.scala:71 - Got status update for unknown executor app-20161008100608-0001/0

【问题讨论】:

    标签: apache-spark cassandra akka datastax datastax-startup


    【解决方案1】:

    这只是执行者说它不能与任何人交谈。我会检查您防火墙上的连接端口等。

    【讨论】:

      猜你喜欢
      • 2017-07-31
      • 1970-01-01
      • 1970-01-01
      • 2017-02-07
      • 1970-01-01
      • 1970-01-01
      • 2012-01-29
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多