一、简介
Kudu是Cloudera开源的分布式列式存储引擎，支持分区、随机读写、批量扫描、实时更新等。可以通过Python API、Java API、Spark API、SQL(如Spark SQL、Impala)等读写Kudu。
二、准备
1、节点分配
kudu171 tserver
kudu172 master tserver
kudu177 master tserver
kudu190 master tserver
kudu209 tserver
2、下载安装包
首先下载需要安装的rpm包，有六个，下载五个就OK。
这里强调下应该注意版本信息，之前就因为系统是centos6。下载的却是centos7的安装包，导致出现一系列的依赖和升级问题层出不穷，最后又只好卸载重装。
下载链接如下：链接标题
下载的包如下：
kudu-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
kudu-client0-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
kudu-client-devel-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
kudu-master-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
kudu-tserver-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
3、进行安装
rpm安装包最好统一放置在机器的同一个目录下：/home/xxxxxx/kudu
所有节点都安装全部下载好的安装包，再去启动相应服务，省去麻烦
代码# yum localinstall kudu-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm kudu-client0-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm kudu-client-devel-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm kudu-master-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm kudu-tserver-1.9.0+cdh6.2.0-967373.el6.x86_64.rpm
这样安装可以解决部分依赖问题，如果还有问题就试一试再在后面加上--nodeps;(--nodeps 如果该RPM包的安装依赖其它包，即使其它包没装，也强迫安装。）
master节点测试下能不能单独启动
代码# service kudu-master start
三、配置
所有节点
代码# cat /etc/hosts
127.0.0.1 localhost kudu172 localhost4 localhost4.localdomain4
::1 localhost localhost6 localhost6.localdomain6
10.4.0.171 kudu171
10.4.0.172 kudu172
10.4.0.177 kudu177
10.4.0.190 kudu190
10.4.0.209 kudu209
(1)、master配置
1、kudu172
代码# cat /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu172:7051
代码# cat /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--master_addresses=kudu172,kudu177,kudu190
--log_dir=/data/kudu/log
--rpc_bind_addresses=kudu172
--logtostderr=true
--fs_wal_dir=/data/kudu/master
--fs_data_dirs=/data/kudu/master
--rpc-encryption=disabled
--rpc_authentication=disabled
2、kudu177
代码# cat /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu177:7051
代码# cat /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--master_addresses=kudu172,kudu177,kudu190
--log_dir=/data/kudu/log
--rpc_bind_addresses=kudu177
--logtostderr=true
--fs_wal_dir=/data/kudu/master
--fs_data_dirs=/data/kudu/master
--rpc-encryption=disabled
--rpc_authentication=disabled
3、kudu190
代码# cat /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu190:7051
代码# cat /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--master_addresses=kudu172,kudu177,kudu190
--log_dir=/data/kudu/log
--rpc_bind_addresses=kudu190
--logtostderr=true
--fs_wal_dir=/data/kudu/master
--fs_data_dirs=/data/kudu/master
--rpc-encryption=disabled
--rpc_authentication=disabled
(2)、tserver配置
1、kudu171
代码# cat /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu171:7050
代码# cat /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/data/kudu/tserver
--fs_data_dirs=/data/kudu/tserver
--tserver_master_addrs=kudu172:7051,kudu177:7051,kudu190:7051
2、kudu172
代码# cat /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu172:7050
代码# cat /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/data/kudu/tserver
--fs_data_dirs=/data/kudu/tserver
--tserver_master_addrs=kudu172:7051,kudu177:7051,kudu190:7051
3、kudu177
代码# cat /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu177:7050
代码# cat /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/data/kudu/tserver
--fs_data_dirs=/data/kudu/tserver
--tserver_master_addrs=kudu172:7051,kudu177:7051,kudu190:7051
4、kudu190
代码# cat /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu190:7050
代码# cat /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/data/kudu/tserver
--fs_data_dirs=/data/kudu/tserver
--tserver_master_addrs=kudu172:7051,kudu177:7051,kudu190:7051
5、kudu209
代码# cat /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=kudu209:7050
代码# cat /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/data/kudu/tserver
--fs_data_dirs=/data/kudu/tserver
--tserver_master_addrs=kudu172:7051,kudu177:7051,kudu190:7051
(3)、配置属组属主，用kudu用户启动
代码# chown -R kudu:kudu /data/kudu
分别执行服务启动
代码# service kudu-master start
代码# service kudu-tserver start
四、验证
1、查看所有masters
http:/kudu172:8051/masters
2、查看所有tservers
http:/kudu172:8051/tservers
若无法访问自行查看日志以及防火墙规则
网友评论