Oozie案例运行MapReduced Workflow

解压oozie-examples.tar.gz

[beifeng@hadoop-senior oozie-4.0.0-cdh5.3.6]$ tar -zxvf oozie-examples.tar.gz

上传Examples

The examples/ directory must be copied to the user HOME directory in HDFS:

[beifeng@hadoop-senior oozie-4.0.0-cdh5.3.6]$ /opt/cdh5.3.6/hadoop-2.5.0-cdh5.3.6/bin/hdfs dfs -put examples examples

自己写的Oozie也需要放到hdfs中。和样例是一样的。

查看namenode端口

bin/yarn jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0-cdh5.3.6.jar pi 1 1

修改job.properties

更新hdfs上的job.properties

[beifeng@hadoop-senior oozie-4.0.0-cdh5.3.6]$ /opt/cdh5.3.6/hadoop-2.5.0-cdh5.3.6/bin/hdfs dfs -put examples/apps/map-reduce/job.properties  examples/apps/map-reduce/

运行MapReduce

Note : The job.properties file needs to be a local file during submissions, and not a HDFS path.

bin/oozie job -oozie http://hadoop-senior.beifeng.com:11000/oozie -config examples/apps/map-reduce/job.properties -run

检查job的状态

bin/oozie job -oozie http://localhost:11000/oozie -info 14-20090525161321-oozie-tucu

设置oozie环境变量后运行

bin/oozie job  -config examples/apps/map-reduce/job.properties -run

image.png

查看结果

http://hadoop-senior.beifeng.com:11000/oozie/