美文网首页
014 Spark自带的jar如何代入到Yarn集群中

014 Spark自带的jar如何代入到Yarn集群中

作者: 逸章 | 来源:发表于2021-02-15 16:55 被阅读0次

    方法一:

    To make Spark runtime jars accessible from YARN side, you can specify spark.yarn.archive or spark.yarn.jars. For details please refer to Spark Properties. If neither spark.yarn.archive nor spark.yarn.jars is specified, Spark will create a zip file with all jars under $SPARK_HOME/jars and upload it to the distributed cache

    image.png

    方法二:

    image.png

    相关文章

      网友评论

          本文标题:014 Spark自带的jar如何代入到Yarn集群中

          本文链接:https://www.haomeiwen.com/subject/einpxltx.html