黑猴子的家：Kylin 之 环境安装部署

1、Kylin官网地址

1）官网地址
http://kylin.apache.org/cn/

2）官方文档
http://kylin.apache.org/cn/docs/

3）下载地址
http://kylin.apache.org/cn/download/

2、安装部署

1）上传到Linux
将apache-kylin-2.5.1-bin-hbase1x.tar.gz上传到 /opt/software目录下

2）解压kylin
解压apache-kylin-2.5.1-bin-hbase1x.tar.gz到/opt/module

[alex@hadoop102 software]$ tar -xzvf apache-kylin-2.5.1-bin-hbase1x.tar.gz -C ../module/

3）配置环境变量

##JAVA_HOME
export JAVA_HOME=/opt/module/jdk1.8.0_144
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin

##HBASE_HOME
export HBASE_HOME=/opt/module/hbase-1.2.5
export PATH=$PATH:$HBASE_HOME/bin

##HIVE_HOME
export HIVE_HOME=/opt/module/hive
export PATH=$PATH:$HIVE_HOME/bin

##HADOOP_HOME
export HADOOP_HOME=/opt/module/hadoop-2.8.2
export PATH=$PATH:$HADOOP_HOME/bin

export CATALINA_HOME=/opt/module/kylin/tomcat
export HIVE_CONF_DIR=$HIVE_HOME/conf
export HCAT_HOME=$HIVE_HOME/hcatalog
export KYLIN_HOME=/opt/module/kylin
export hive_dependency=$HIVE_HOME/conf:$HIVE_HOME/lib/*:$HCAT_HOME/share/hcatalog/hive-hcatalog-core-1.1.0.jar

4）检查环境变量

##加载环境变量
[alex@hadoop102 kylin]$ source /etc/profile

Hive
[alex@hadoop102 kylin]$ hive --version
Hive 1.2.1
Subversion git://localhost.localdomain/home/sush/dev/hive.git -r 243e7c1ac39cb7ac8b65c5bc6988f5cc3162f558
Compiled by sush on Fri Jun 19 02:03:48 PDT 2015
From source with checksum ab480aca41b24a9c3751b8c023338231

Hbase
[alex@hadoop102 kylin]$ hbase version
HBase 1.2.5
Source code repository git://asf-dev/home/busbey/projects/hbase revision=d7b05f79dee10e0ada614765bb354b93d615a157
Compiled by busbey on Wed Mar  1 00:34:48 CST 2017
From source with checksum 5f0b6bf70e891eb3b315a1559f0a1c62

Hadoop
[alex@hadoop102 kylin]$ hadoop version
Hadoop 2.8.2
Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r 66c47f2a01ad9637879e95f80c41f798373828fb
Compiled by jdu on 2017-10-19T20:39Z
Compiled with protoc 2.5.0
From source with checksum dce55e5afe30c210816b39b631a53b1d
This command was run using /opt/module/hadoop-2.8.2/share/hadoop/common/hadoop-common-2.8.2.jar

5）启动前置服务

启动zookeeper
[alex@hadoop102 zookeeper-3.4.10]$ /bin/zkServer.sh start
[alex@hadoop103 zookeeper-3.4.10]$ /bin/zkServer.sh start
[alex@hadoop104 zookeeper-3.4.10]$ /bin/zkServer.sh start

启动hadoop-hdfs
[alex@hadoop102 hadoop-2.8.2]$ sbin/start-dfs.sh
http://hadoop102:50070/

启动JobHistoryServer  否则kylin build的时候报10020错误
[alex@hadoop102 hadoop-2.8.2]$ sbin/mr-jobhistory-daemon.sh start historyserver
http://hadoop102:19888/

启动hadoop-yarn
[alex@hadoop103 hadoop-2.8.2]$ sbin/start-yarn.sh
http://hadoop103:8088/

启动hbase
[alex@hadoop103 hbase-1.2.5]$ bin/start-hbase.sh
http://hadoop103:16010/

[alex@hadoop102 apache-hive-1.2.1-bin]$ bin/hive
hive>

6）启动

[alex@hadoop102 module]$ ln -s apache-kylin-2.5.1-bin-hbase1x/ kylin
[alex@hadoop102 kylin]$ bin/kylin.sh start

尖叫提示1：需要在/etc/profile文件中配置HADOOP_HOME，HIVE_HOME，HBASE_HOME并source使其生效，并且在启动kylin之前，先启动zookeeper、mysql、hadoop(mapreduce和yarn)、Hive、Hbase

尖叫提示2： 启动kylin之前，记得修改bin/kylin.sh 脚本，具体方法在添加数据哪一个小节上

尖叫提示3：kylin 的启动和使用是否success，主要和集群配置有关，集群配置信息，在第六章有具体描述

[alex@hadoop102 kylin]$ bin/kylin.sh start & echo $! > kylin.pid

7）查看阶段状态
kylin
启动之后查看各个节点进程

--------------------- hadoop102 ----------------
3360 JobHistoryServer
3282 NodeManager
3026 DataNode
53283 Jps
2886 NameNode
44007 RunJar  ->  kylin
2728 QuorumPeerMain
31566 HRegionServer
--------------------- hadoop103 ----------------
5040 HMaster
2864 ResourceManager
9729 Jps
2657 QuorumPeerMain
4946 HRegionServer
2979 NodeManager
2727 DataNode
--------------------- hadoop104 ----------------
4688 HRegionServer
2900 NodeManager
9848 Jps
2636 QuorumPeerMain
2700 DataNode
2815 SecondaryNameNode

8）访问
http://hadoop102:7070/kylin

9）登陆成功页面
用户名密码
username:ADMIN
password:KYLIN

10）关闭kylin服务

[alex@hadoop102 kylin]$ bin/kylin.sh stop