spark中的纱线模式和部署模式有什么区别？答案

【问题标题】：What is different between yarn mode and deploy mode in spark?spark中的纱线模式和部署模式有什么区别？
【发布时间】：2022-01-23 09:55:00
【问题描述】：

我现在很困惑。请检查这是否正确。

4 例命令如下：

# It mean, yarn is cluster mode and deploy cluster mode.
# cluster have YARN Container(have Spark AM, Spark Driver) and YARN node manager.
spark-submit --master yarn --deploy-mode cluster

# It mean, yarn is cluster mode and deploy client mode.
# client have Spark Driver.
# cluster have YARN Container(have Spark AM, Spark Driver) and YARN node manager.
spark-submit --master yarn --deploy-mode client

# It mean, yarn is client mode and deploy cluster mode.
# cluster have YARN Container(have Spark AM) and YARN node manager.
spark-submit --master yarn-client --deploy-mode cluster

# It mean, yarn is client mode and deploy client mode.
# client have Spark Driver.
# cluster have YARN Container(have Spark AM) and YARN node manager.
spark-submit --master yarn-client --deploy-mode client

上述代码的解释是否正确？

【问题讨论】：

标签： apache-spark hadoop-yarn

【解决方案1】：

#使用yarn，将驱动部署到yarn集群中。

spark-submit --master yarn --deploy-mode cluster

#使用yarn，将驱动部署在我的本地机器（正在启动代码的机器）

spark-submit --master yarn --deploy-mode client # this is the default if you don't specify --deploy-mode

这些不再是actual options，所以它们真的不值得讨论：

spark-submit --master yarn-client --deploy-mode cluster
spark-submit --master yarn-client --deploy-mode client

--master yarn-client 在早期版本的 spark 中可能是一个选项，但今天没有使用。（如上述文档中所引用的）

【讨论】：