美文网首页
mac os安装spark

mac os安装spark

作者: 微澜55 | 来源:发表于2020-03-06 18:27 被阅读0次

1.安装jdk

下载安装包

https://www.oracle.com/java/technologies/javase-jdk13-downloads.html

jdk.png

安装:

从finder中找到下载的jdk,按照提示安装即可

java -version 
# 结果中出现 java version "13.0.2" 即为安装成功

2.安装spark

下载安装包

https://www.apache.org/dyn/closer.lua/spark/spark-3.0.0-preview2/spark-3.0.0-preview2-bin-hadoop2.7.tgz

spark.png

安装步骤:

cd /usr/local
mv ~/Downloads/spark-3.0.0-preview2-bin-hadoop2.7.tgz . # 下载spark在Downloads目录中
tar -zxvf spark-3.0.0-preview2-bin-hadoop2.7.tgz
vim ~/.bash_profile
# bash_profile中添加如下配置
export SPARK_HOME=/usr/local/spark-3.0.0-preview2-bin-hadoop2.7
export PATH=$PATH:$SPARK_HOME/bin
export PYSPARK_PYTHON=python3
#
source ~/.bash_profile
pip install pyspark # 安装pyspark

验证:

命令行输入 pyspark即可验证

相关文章

网友评论

      本文标题:mac os安装spark

      本文链接:https://www.haomeiwen.com/subject/sngwrhtx.html