美文网首页
基于storm集群运行计算拓扑

基于storm集群运行计算拓扑

作者: sknfie | 来源:发表于2020-09-29 11:31 被阅读0次

    概述

    利用storm集群运行计算拓扑:WordCountTopology

    打包

    利用工具生成storm-helloworld-0.0.1-SNAPSHOT.jar。

    提交作业到 storm 集群

    [root@dlsc-201-33 storm]# storm jar storm-helloworld-0.0.1-SNAPSHOT.jar com.roncoo.eshop.storm.WordCountTopology WordCountTopology
    
    Running: java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/storm-core-1.1.0.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/ring-cors-0.1.5.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/lib/log4j-api-2.8.jar:/usr/local/storm/lib/log4j-core-2.8.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.8.jar:/usr/local/storm/lib/slf4j-api-1.7.21.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/storm-rename-hack-1.1.0.jar:storm-helloworld-0.0.1-SNAPSHOT.jar:/usr/local/storm/conf:/usr/local/storm/bin -Dstorm.jar=storm-helloworld-0.0.1-SNAPSHOT.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} com.roncoo.eshop.storm.WordCountTopology WordCountTopology
    644  [main] INFO  o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -6437052318388483640:-5062795739657863506
    773  [main] INFO  o.a.s.u.NimbusClient - Found leader nimbus : dlsc-201-33:6627
    807  [main] INFO  o.a.s.s.a.AuthUtils - Got AutoCreds []
    813  [main] INFO  o.a.s.u.NimbusClient - Found leader nimbus : dlsc-201-33:6627
    865  [main] INFO  o.a.s.StormSubmitter - Uploading dependencies - jars...
    866  [main] INFO  o.a.s.StormSubmitter - Uploading dependencies - artifacts...
    867  [main] INFO  o.a.s.StormSubmitter - Dependency Blob keys - jars : [] / artifacts : []
    878  [main] INFO  o.a.s.StormSubmitter - Uploading topology jar storm-helloworld-0.0.1-SNAPSHOT.jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-16e1e077-a0e2-4ea2-a286-3522fb2881e3.jar
    909  [main] INFO  o.a.s.StormSubmitter - Successfully uploaded topology jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-16e1e077-a0e2-4ea2-a286-3522fb2881e3.jar
    910  [main] INFO  o.a.s.StormSubmitter - Submitting topology WordCountTopology in distributed mode with conf {"topology.workers":3,"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-6437052318388483640:-5062795739657863506"}
    1760 [main] INFO  o.a.s.StormSubmitter - Finished submitting topology: WordCountTopology
    

    查看storm UI

    WordCountTopology
    topology
    Supervisor
    Executors
    logviewer
    kill

    相关文章

      网友评论

          本文标题:基于storm集群运行计算拓扑

          本文链接:https://www.haomeiwen.com/subject/rwosuktx.html