kafka集群：

kafka-1：192.168.19.202

kafka-2：192.168.19.203

1、部署zookeeper集群

以下步骤集群每个节点都要做，特别的步骤再做说明。

添加hosts

[root@kafka-1 ~]# vim /etc/hosts

192.168.19.202 kafka-1

192.168.19.203 kafka-2

安装jdk，安装zookeeper，添加环境变量参考kafka安装

编辑配置文件zoo.cfg

[root@kafka-1 ~]# vim /usr/zookeeper-3.4.8/conf/zoo.cfg

server.1=192.168.19.202:2888:3888

server.2=192.168.19.203:2888:3888

[root@kafka-1 ~]# vim /usr/zookeeper-3.4.8/conf/zoo.cfg

dataDir=/data/zookeeper/data

[root@kafka-1 ~]# mkdir -p /data/zookeeper/data

[root@kafka-1 ~]# cd /data/zookeeper/data/

[root@kafka-1 data]# ls

[root@kafka-1 data]# echo 1 > myid

[root@kafka-1 data]# ls

myid

[root@kafka-1 data]# cat myid

1

[root@kafka-2 ~]# cd /data/zookeeper/data/

[root@kafka-2 data]# echo 2 > myid

[root@kafka-2 data]# ls

myid

[root@kafka-2 data]# cat myid

2

myid的数值与zoo.cfg里“server.1”的数字对应

服务启动

[root@kafka-1 bin]# zkServer.sh start

ZooKeeper JMX enabled by default

Using config: /usr/zookeeper-3.4.8/bin/../conf/zoo.cfg

Starting zookeeper ... STARTED

查看状态

[root@kafka-1 bin]# zkServer.sh status

ZooKeeper JMX enabled by default

Using config: /usr/zookeeper-3.4.8/bin/../conf/zoo.cfg

Mode: leader

[root@kafka-2 bin]# zkServer.sh start

ZooKeeper JMX enabled by default

Using config: /usr/zookeeper-3.4.8/bin/../conf/zoo.cfg

Starting zookeeper ... STARTED

查看状态

[root@kafka-1 bin]# zkServer.sh status

ZooKeeper JMX enabled by default

Using config: /usr/zookeeper-3.4.8/bin/../conf/zoo.cfg

Mode: follower

安装kafka--参考kafka安装

kafka配置，编辑配置文件server.properties

[root@kafka-1 config]# vim server.properties

broker.id=1（正整数，唯一）

host.name=192.168.19.202（可有可无）

log.retention.hours=168

message.max.byte=5242880

default.replication.factor=2

replica.fetch.max.bytes=5242880

zookeeper.connect=192.168.19.202:2181,192.168.19.203:2181（指定zookeeper集群）

[root@kafka-2 config]# vim server.properties

broker.id=2

host.name=192.168.19.203

log.retention.hours=168

message.max.byte=5242880

default.replication.factor=2

replica.fetch.max.bytes=5242880

zookeeper.connect=192.168.19.202:2181,192.168.19.203:2181

kafka开启

[root@kafka-1 kafka_2.11-0.11.0.1]# ./bin/kafka-server-start.sh config/server.properties &

[1] 2614

[root@kafka-2 kafka_2.11-0.11.0.1]# ./bin/kafka-server-start.sh config/server.properties &

[1] 2625

[root@kafka-1 kafka_2.11-0.11.0.1]# jps

2526 QuorumPeerMain

3780 Jps

3485 Kafka

[root@kafka-2 kafka_2.11-0.11.0.1]# jps

3765 Jps

3478 Kafka

2532 QuorumPeerMain

创建topic

[root@kafka-1 kafka_2.11-0.11.0.1]# ./bin/kafka-topics.sh --create --zookeeper 192.168.19.202:2181,192.168.19.203:2181 --replication-factor 2 --partitions 1 --topic xia

Created topic "xia".

查看已创建的topic

[root@kafka-1 kafka_2.11-0.11.0.1]# ./bin/kafka-topics.sh --list --zookeeper 192.168.19.202:2181,192.168.19.203:2181

xia

发送消息（192.168.19.202）

[root@kafka-1 kafka_2.11-0.11.0.1]# ./bin/kafka-console-producer.sh --broker-list 192.168.19.202:9092 --topic xia

>this is a test too

接收消息（192.168.19.203）

[root@kafka-2 kafka_2.11-0.11.0.1]# ./bin/kafka-console-consumer.sh --zookeeper 192.168.19.202:2181,192.168.19.203:2181 --topic xia --from-beginning

Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].

this is a test too

this is a test too