美文网首页
014 Spark自带的jar如何代入到Yarn集群中

014 Spark自带的jar如何代入到Yarn集群中

作者: 逸章 | 来源:发表于2021-02-15 16:55 被阅读0次

方法一:

To make Spark runtime jars accessible from YARN side, you can specify spark.yarn.archive or spark.yarn.jars. For details please refer to Spark Properties. If neither spark.yarn.archive nor spark.yarn.jars is specified, Spark will create a zip file with all jars under $SPARK_HOME/jars and upload it to the distributed cache

image.png

方法二:

image.png

相关文章

网友评论

      本文标题:014 Spark自带的jar如何代入到Yarn集群中

      本文链接:https://www.haomeiwen.com/subject/einpxltx.html