美文网首页
黑猴子的家:Kylin 之 环境安装部署

黑猴子的家:Kylin 之 环境安装部署

作者: 黑猴子的家 | 来源:发表于2020-02-07 11:19 被阅读0次

    1、Kylin官网地址

    1)官网地址
    http://kylin.apache.org/cn/

    2)官方文档
    http://kylin.apache.org/cn/docs/

    3)下载地址
    http://kylin.apache.org/cn/download/

    2、安装部署

    1)上传到Linux
    将apache-kylin-2.5.1-bin-hbase1x.tar.gz上传到 /opt/software目录下

    2)解压kylin
    解压apache-kylin-2.5.1-bin-hbase1x.tar.gz到/opt/module

    [alex@hadoop102 software]$ tar -xzvf apache-kylin-2.5.1-bin-hbase1x.tar.gz -C ../module/
    

    3)配置环境变量

    ##JAVA_HOME
    export JAVA_HOME=/opt/module/jdk1.8.0_144
    export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
    export PATH=$PATH:$JAVA_HOME/bin
    
    ##HBASE_HOME
    export HBASE_HOME=/opt/module/hbase-1.2.5
    export PATH=$PATH:$HBASE_HOME/bin
    
    ##HIVE_HOME
    export HIVE_HOME=/opt/module/hive
    export PATH=$PATH:$HIVE_HOME/bin
    
    ##HADOOP_HOME
    export HADOOP_HOME=/opt/module/hadoop-2.8.2
    export PATH=$PATH:$HADOOP_HOME/bin
    
    export CATALINA_HOME=/opt/module/kylin/tomcat
    export HIVE_CONF_DIR=$HIVE_HOME/conf
    export HCAT_HOME=$HIVE_HOME/hcatalog
    export KYLIN_HOME=/opt/module/kylin
    export hive_dependency=$HIVE_HOME/conf:$HIVE_HOME/lib/*:$HCAT_HOME/share/hcatalog/hive-hcatalog-core-1.1.0.jar
    

    4)检查环境变量

    ##加载环境变量
    [alex@hadoop102 kylin]$ source /etc/profile
    
    Hive
    [alex@hadoop102 kylin]$ hive --version
    Hive 1.2.1
    Subversion git://localhost.localdomain/home/sush/dev/hive.git -r 243e7c1ac39cb7ac8b65c5bc6988f5cc3162f558
    Compiled by sush on Fri Jun 19 02:03:48 PDT 2015
    From source with checksum ab480aca41b24a9c3751b8c023338231
    
    Hbase
    [alex@hadoop102 kylin]$ hbase version
    HBase 1.2.5
    Source code repository git://asf-dev/home/busbey/projects/hbase revision=d7b05f79dee10e0ada614765bb354b93d615a157
    Compiled by busbey on Wed Mar  1 00:34:48 CST 2017
    From source with checksum 5f0b6bf70e891eb3b315a1559f0a1c62
    
    Hadoop
    [alex@hadoop102 kylin]$ hadoop version
    Hadoop 2.8.2
    Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r 66c47f2a01ad9637879e95f80c41f798373828fb
    Compiled by jdu on 2017-10-19T20:39Z
    Compiled with protoc 2.5.0
    From source with checksum dce55e5afe30c210816b39b631a53b1d
    This command was run using /opt/module/hadoop-2.8.2/share/hadoop/common/hadoop-common-2.8.2.jar
    

    5)启动前置服务

    启动zookeeper
    [alex@hadoop102 zookeeper-3.4.10]$ /bin/zkServer.sh start
    [alex@hadoop103 zookeeper-3.4.10]$ /bin/zkServer.sh start
    [alex@hadoop104 zookeeper-3.4.10]$ /bin/zkServer.sh start
    
    启动hadoop-hdfs
    [alex@hadoop102 hadoop-2.8.2]$ sbin/start-dfs.sh
    http://hadoop102:50070/
    
    启动JobHistoryServer  否则kylin build的时候报10020错误
    [alex@hadoop102 hadoop-2.8.2]$ sbin/mr-jobhistory-daemon.sh start historyserver
    http://hadoop102:19888/
    
    启动hadoop-yarn
    [alex@hadoop103 hadoop-2.8.2]$ sbin/start-yarn.sh
    http://hadoop103:8088/
    
    启动hbase
    [alex@hadoop103 hbase-1.2.5]$ bin/start-hbase.sh
    http://hadoop103:16010/
    
    [alex@hadoop102 apache-hive-1.2.1-bin]$ bin/hive
    hive>
    

    6)启动

    [alex@hadoop102 module]$ ln -s apache-kylin-2.5.1-bin-hbase1x/ kylin
    [alex@hadoop102 kylin]$ bin/kylin.sh start
    

    尖叫提示1:需要在/etc/profile文件中配置HADOOP_HOME,HIVE_HOME,HBASE_HOME并source使其生效,并且在启动kylin之前,先启动zookeeper、mysql、hadoop(mapreduce和yarn)、Hive、Hbase

    尖叫提示2: 启动kylin之前,记得修改bin/kylin.sh 脚本,具体方法在添加数据哪一个小节上

    尖叫提示3:kylin 的启动和使用是否success,主要和集群配置有关,集群配置信息,在第六章有具体描述

    [alex@hadoop102 kylin]$ bin/kylin.sh start & echo $! > kylin.pid
    

    7)查看阶段状态
    kylin
    启动之后查看各个节点进程

    --------------------- hadoop102 ----------------
    3360 JobHistoryServer
    3282 NodeManager
    3026 DataNode
    53283 Jps
    2886 NameNode
    44007 RunJar  ->  kylin
    2728 QuorumPeerMain
    31566 HRegionServer
    --------------------- hadoop103 ----------------
    5040 HMaster
    2864 ResourceManager
    9729 Jps
    2657 QuorumPeerMain
    4946 HRegionServer
    2979 NodeManager
    2727 DataNode
    --------------------- hadoop104 ----------------
    4688 HRegionServer
    2900 NodeManager
    9848 Jps
    2636 QuorumPeerMain
    2700 DataNode
    2815 SecondaryNameNode
    

    8)访问
    http://hadoop102:7070/kylin

    9)登陆成功页面
    用户名密码
    username:ADMIN
    password:KYLIN

    10)关闭kylin服务

    [alex@hadoop102 kylin]$ bin/kylin.sh stop
    

    相关文章

      网友评论

          本文标题:黑猴子的家:Kylin 之 环境安装部署

          本文链接:https://www.haomeiwen.com/subject/vlkmxhtx.html