Hbase分布式集群

Hbase分布式集群

官方网站:

http://hbase.apache.org/

http://hbase.apache.org/book.html

环境:

CentOS 7.1

hadoop-2.7.2

hbase-1.2.1

jdk-1.8

说明:仅个人测试学习记录，大神们可以一笑而过

Table 1. Distributed Cluster Demo Architecture

Node Name	Master	ZooKeeper	RegionServer
node-a.example.com	yes	yes	no
node-b.example.com	backup	yes	yes
node-c.example.com	no	yes	yes

前提

至少有一个可用的hdfs实例能正常被hbase所访问

这里直接使用node-a节点的hdfs，请参看Hadoop单节点集群

所以之前core-site.xml里的hdfs://localhost:8020需要改为hdfs://node-a.example.com:8020

安装hbase(所有节点)

请参看Hbase单节点Standalone & Pseudo Distribute

配置

1.ssh 密钥认证(node-a.example.com上操作)

node-a需要登录到node-b,node-c上启动daemon

su - hbadmin

ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa

ssh-copy-id -i ~/.ssh/id_dsa.pub node-b.example.com

ssh-copy-id -i ~/.ssh/id_dsa.pub node-c.example.com

2.配置文件修改(node-a.example.com上操作)

a.regionservers

cat >/opt/hbase/conf/regionservers <<HERE

node-b.example.com

node-c.example.com

HERE

b.backup-masters

cat >/opt/hbase/conf/backup-masters <<HERE

node-b.example.com

HERE

c.zookeeper

/opt/hbase/conf/hbase-site.xml中添加如下选项

注意:因为是集群环境，所以需要将localhost全部替换为能解析的主机名或IP地址

d.同步配置到所有节点(node-a.example.com上操作)

scp -rp /opt/hbase/conf node-b.example.com:/opt/hbase

scp -rp /opt/hbase/conf node-b.example.com:/opt/hbase

启动集群

[hbadmin@node-a ~]$ /opt/hbase/bin/start-hbase.sh

node-c.example.com: starting zookeeper, logging to /opt/hbase/bin/../logs/hbase-hbadmin-zookeeper-node-c.example.com.out

node-b.example.com: starting zookeeper, logging to /opt/hbase/bin/../logs/hbase-hbadmin-zookeeper-node-b.example.com.out

node-a.example.com: starting zookeeper, logging to /opt/hbase/bin/../logs/hbase-hbadmin-zookeeper-node-a.example.com.out

starting master, logging to /opt/hbase/bin/../logs/hbase-hbadmin-master-node-a.example.com.out

node-b.example.com: starting regionserver, logging to /opt/hbase/bin/../logs/hbase-hbadmin-regionserver-node-b.example.com.out

node-c.example.com: starting regionserver, logging to /opt/hbase/bin/../logs/hbase-hbadmin-regionserver-node-c.example.com.out

node-b.example.com: starting master, logging to /opt/hbase/bin/../logs/hbase-hbadmin-master-node-b.example.com.out

可以看到启动顺序为zookeeper,master,regionserver,backup master

如果启动失败，请查看报错提示并结合日志排查

[hbadmin@node-a ~]$ /opt/jdk/bin/jps

8076 HMaster

8223 Jps

7967 HQuorumPeer

[hbadmin@node-b ~]$ /opt/jdk/bin/jps

2578 HRegionServer

2503 HQuorumPeer

2653 HMaster

2862 Jps

[hbadmin@node-c ~]$ /opt/jdk/bin/jps

2997 Jps

2794 HQuorumPeer

2877 HRegionServer

web UI

说明:hbase版本比0.98.x要新的web UI端口由60010(Master),60030(RegionServer)变为

16010(Master),16030(RegionServer)

http://node-a.example.com:16010/

http://node-b.example.com:16010/

http://node-b.example.com:16030/

http://node-c.example.com:16030/