概述
利用storm集群运行计算拓扑:WordCountTopology
打包
利用工具生成storm-helloworld-0.0.1-SNAPSHOT.jar。
提交作业到 storm 集群
[root@dlsc-201-33 storm]# storm jar storm-helloworld-0.0.1-SNAPSHOT.jar com.roncoo.eshop.storm.WordCountTopology WordCountTopology
Running: java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/storm-core-1.1.0.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/ring-cors-0.1.5.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/lib/log4j-api-2.8.jar:/usr/local/storm/lib/log4j-core-2.8.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.8.jar:/usr/local/storm/lib/slf4j-api-1.7.21.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/storm-rename-hack-1.1.0.jar:storm-helloworld-0.0.1-SNAPSHOT.jar:/usr/local/storm/conf:/usr/local/storm/bin -Dstorm.jar=storm-helloworld-0.0.1-SNAPSHOT.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} com.roncoo.eshop.storm.WordCountTopology WordCountTopology
644 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -6437052318388483640:-5062795739657863506
773 [main] INFO o.a.s.u.NimbusClient - Found leader nimbus : dlsc-201-33:6627
807 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
813 [main] INFO o.a.s.u.NimbusClient - Found leader nimbus : dlsc-201-33:6627
865 [main] INFO o.a.s.StormSubmitter - Uploading dependencies - jars...
866 [main] INFO o.a.s.StormSubmitter - Uploading dependencies - artifacts...
867 [main] INFO o.a.s.StormSubmitter - Dependency Blob keys - jars : [] / artifacts : []
878 [main] INFO o.a.s.StormSubmitter - Uploading topology jar storm-helloworld-0.0.1-SNAPSHOT.jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-16e1e077-a0e2-4ea2-a286-3522fb2881e3.jar
909 [main] INFO o.a.s.StormSubmitter - Successfully uploaded topology jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-16e1e077-a0e2-4ea2-a286-3522fb2881e3.jar
910 [main] INFO o.a.s.StormSubmitter - Submitting topology WordCountTopology in distributed mode with conf {"topology.workers":3,"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-6437052318388483640:-5062795739657863506"}
1760 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: WordCountTopology
查看storm UI
WordCountTopologytopology
Supervisor
Executors
logviewer
kill
网友评论