总体参考:http://www.cnblogs.com/zhangs1986/p/6564839.html
搭建之间同步下spark01、02、03的环境
复制/opt/flume这个文件夹到 spark02的/opt目录下,同理03
scp -r /opt/flume/ spark02:/opt/
scp -r /opt/kafka/ spark02:/opt/
scp -r /opt/zookeeper/ spark02:/opt/
1、下载zookeeper,安装
2、集群搭建配置zookeeper的zoo.cfg
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=5
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=2
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/opt/zookeeper/zookeeper-3.4.12/data
dataLogDir=/opt/zookeeper/zookeeper-3.4.12/log
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc\_maintenance
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
server.0=192.168.2.245:2888:3888
server.1=192.168.2.246:2888:3888
server.2=192.168.2.247:2888:3888
3、在01、01、03的data路径下分别新建myid文件
touch myid
vi myid
每一个myid分别对应zoo.cfg里的server.后面的0/1/2.
[root@spark01 zookeeper-3.4.12]# cd data
[root@spark01 data]# ls
myid version-2 zookeeper_server.pid
[root@spark01 data]# cat myid
0
4、启动zookeeper集群
分别进入每台zookeeper的/bin目录, 启动server。
zkServer.sh start查看启动状态:
zkServer.sh status分别是:
[root@spark01 bin]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper/zookeeper-3.4.12/bin/../conf/zoo.cfg
Mode: follower
[root@spark02 bin]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper/zookeeper-3.4.12/bin/../conf/zoo.cfg
Mode: follower
[root@spark03 bin]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper/zookeeper-3.4.12/bin/../conf/zoo.cfg
Mode: leader
我是先启动的03,然后02,然后01
如果关闭zookeeper,使用命令zkServer.sh stop