美文网首页大数据
storm集群安装

storm集群安装

作者: 57山本无忧 | 来源:发表于2018-01-21 14:03 被阅读0次

    一、环境准备

    1.1 基础环境

    主机名称 IP地址
    storm-nimbus 192.168.200.110
    storm-supervisor1 192.168.200.111
    storm-supervisor2 192.168.200.112
    [root@storm-supervisor1 ~]# uname -a
    Linux storm-supervisor1 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
    [root@storm-supervisor1 ~]# getenforce 
    Disabled
    

    1.1.1 增加主机名配置

    增加storm主机名称【3台服务器】

    echo -e '192.168.200.110 storm-nimbus\n192.168.200.111 storm-supervisor1\n192.168.200.112 storm-supervisor2'>>/etc/hosts&&tail -3 /etc/hosts
    

    增加zookeeper主机名称【3台服务器】

    echo -e '192.168.200.61 zookeeper1\n192.168.200.62 zookeeper2\n192.168.200.63 zookeeper3'>>/etc/hosts&&tail -3 /etc/hosts
    

    1.2 安装JDK

    请参考:Linux下快速安装JDK

    1.3 安装zookeeper

    请参考:zookeeper集群搭建指南

    二、安装storm

    2.1 下载

    wget http://mirrors.hust.edu.cn/apache/storm/apache-storm-1.0.5/apache-storm-1.0.5.tar.gz
    

    2.2 解压安装

    tar zxf /usr/local/src/apache-storm-1.0.5.tar.gz -C /usr/local/
    ln -s /usr/local/apache-storm-1.0.5 /usr/local/storm
    

    2.3 配置环境变量

    echo 'export STORM_HOME=/usr/local/storm' >> /etc/profile&&echo 'export PATH=$STORM_HOME/bin:$PATH' >> /etc/profile&&source /etc/profile&&tail -2 /etc/profile
    

    2.4 配置storm

    vim /usr/local/storm/conf/storm.yaml
    

    指定zookeeper

     storm.zookeeper.servers:
         - "zookeeper1"
         - "zookeeper2"
         - "zookeeper3"
    

    Nimbus和Supervisor守护进程需要在本地磁盘上的目录来存储少量的状态

     storm.local.dir: "/usr/local/storm/status"
    

    配置nimbus.seeds:用于配置主控节点的地址,可以配置多个

    nimbus.seeds: ["storm-nimbus"]
    

    配置supervisor.slots.ports

    supervisor.slots.ports:
        - 6700
        - 6701
        - 6702
        - 6703
    

    2.5 启动storm

    启动nimbus和supervisor

    storm nimbus
    storm supervisor
    

    查看日志

    tail -f /usr/local/storm/logs/nimbus.log
    tail -f /usr/local/storm/logs/supervisor.log
    

    2.6 启动storm UI

    storm ui
    tail -f /usr/local/storm/logs/ui.log 
    

    访问:http://192.168.200.110:8080/index.html

    相关参考

    storm中文博客

    相关文章

      网友评论

        本文标题:storm集群安装

        本文链接:https://www.haomeiwen.com/subject/vmgfaxtx.html