今天利用intellij IDEA(15.0.6)编译通过了sparkpi程序,按照http://dongxicheng.org/framework-on-yarn/apache-spark-intellij-idea/里的教程,已经把scala程序打包成jar包,想在hadoop-2.6.0的集群里spark-1.6.0进行测试运行,在命令行输入如下:./spark-submit --class org.apache.spark.examples.SparkPi --master spark://master:7077 /usr/local/workspace/ideal/out/artifacts/idealtest2_jar/,提示报错:java.lang.ClassNotFoundException: org.apache.spark.examples.SparkPi
intellij IDEA程序如下:
搭建环境:intellij IDEA(15.0.6)+hadoop(2.6.0)+scala(2.10.4)+java(1.8.0.-131)+spark(1.6.0)
网友评论