redis-cluster集群
Redis集群搭建的方式有多种,例如使用zookeeper等,但从redis 3.0之后版本支持redis-cluster集群,Redis-Cluster采用无中心结构,每个节点保存数据和整个集群状态,每个节点都和其他所有节点连接。其redis-cluster架构图如下:
其结构特点:
- 所有的redis节点彼此互联(PING-PONG机制),内部使用二进制协议优化传输速度和带宽。
- 节点的fail是通过集群中超过半数的节点检测失效时才生效。
- 客户端与redis节点直连,不需要中间proxy层.客户端不需要连接集群所有节点,连接集群中任何一个可用节点即可。
- redis-cluster把所有的物理节点映射到[0-16383]slot上(不一定是平均分配),cluster 负责维护node<->slot<->value。
- Redis集群预分好16384个桶,当需要在 Redis 集群中放置一个 key-value 时,根据 CRC16(key) mod 16384的值,决定将一个key放到哪个桶中。
1.1 Redis Cluster主从模式
- redis cluster 为了保证数据的高可用性,加入了主从模式,一个主节点对应一个或多个从节点,主节点提供数据存取,从节点则是从主节点拉取数据备份,当这个主节点挂掉后,就会有这个从节点选取一个来充当主节点,从而保证集群不会挂掉。
- 上面那个例子里, 集群有ABC三个主节点, 如果这3个节点都没有加入从节点,如果B挂掉了,我们就无法访问整个集群了。A和C的slot也无法访问。
- 所以我们在集群建立的时候,一定要为每个主节点都添加了从节点, 比如像这样, 集群包含主节点A、B、C, 以及从节点A1、B1、C1, 那么即使B挂掉系统也可以继续正确工作。
- B1节点替代了B节点,所以Redis集群将会选择B1节点作为新的主节点,集群将会继续正确地提供服务。 当B重新开启后,它就会变成B1的从节点。
- 不过需要注意,如果节点B和B1同时挂了,Redis集群就无法继续正确地提供服务了。
redis架构如图:
- 10.0.0.61 Redis01
- 10.0.0.62 Redis02
- 10.0.0.63 Redis03
- 在每个节点搭建两个redis,在任意一个节点安装ruby环境
- 记得关闭防火墙,或者开放对应端口
1.2 在每个节点安装redis
[root@redis01 ~]# cd /usr/local/src/ [root@redis01 src]# wget http://download.redis.io/releases/redis-3.2.8.tar.gz --2017-12-26 18:27:29-- http://download.redis.io/releases/redis-3.2.8.tar.gz Resolving download.redis.io (download.redis.io)... 109.74.203.151 Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1547237 (1.5M) [application/x-gzip] Saving to: ‘redis-3.2.8.tar.gz’ 100%[==================================================================================================================================>] 1,547,237 32.3KB/s in 23s 2017-12-26 18:27:53 (64.7 KB/s) - ‘redis-3.2.8.tar.gz’ saved [1547237/1547237] [root@redis01 src]# tar xf redis-3.2.8.tar.gz [root@redis01 src]# cd redis-3.2.8/ [root@redis01 redis-3.2.8]# make [root@redis01 redis-3.2.8]# make PREFIX=/usr/local/redis_m install [root@redis01 ~]# echo "export PATH=/usr/local/redis_m/bin:$PATH" >>/etc/profile [root@redis01 ~]# source /etc/profile [root@redis01 ~]# cd /usr/local/redis_m/ [root@redis01 redis_m]# mkdir -p conf [root@redis01 redis_m]# cp /usr/local/src/redis-3.2.8/redis.conf conf/
- 修改redis_m的redis.conf
bind 10.0.0.61 protected-mode yes port 6379 tcp-backlog 511 timeout 0 tcp-keepalive 300 cluster-enabled yes cluster-config-file nodes_6379.conf #启动首次生成 cluster-node-timeout 15000 daemonize yes supervised no pidfile "/var/run/redis_6379.pid" loglevel notice logfile "" databases 16 save 900 1 save 300 10 save 60 10000 stop-writes-on-bgsave-error yes rdbcompression yes rdbchecksum yes dbfilename "dump.rdb" dir "/usr/local/redis_m/conf" slave-serve-stale-data yes slave-read-only yes repl-diskless-sync no repl-diskless-sync-delay 5 repl-disable-tcp-nodelay no slave-priority 100 appendonly no appendfilename "appendonly.aof" appendfsync everysec no-appendfsync-on-rewrite no auto-aof-rewrite-percentage 100 auto-aof-rewrite-min-size 64mb aof-load-truncated yes lua-time-limit 5000 slowlog-log-slower-than 10000 slowlog-max-len 128 latency-monitor-threshold 0 notify-keyspace-events "" hash-max-ziplist-entries 512 hash-max-ziplist-value 64 list-max-ziplist-size -2 list-compress-depth 0 set-max-intset-entries 512 zset-max-ziplist-entries 128 zset-max-ziplist-value 64 hll-sparse-max-bytes 3000 activerehashing yes client-output-buffer-limit normal 0 0 0 client-output-buffer-limit slave 256mb 64mb 60 client-output-buffer-limit pubsub 32mb 8mb 60 hz 10 aof-rewrite-incremental-fsync yes
在本机搭建第二个redis
[root@redis01 conf]# cd /usr/local/ [root@redis01 conf]# cp -r redis_m redis_s #修改节点2 redis_s的配置文件 bind 10.0.0.61 protected-mode yes port 6380 tcp-backlog 511 timeout 0 tcp-keepalive 300 cluster-enabled yes cluster-config-file nodes_6380.conf cluster-node-timeout 15000 daemonize yes supervised no pidfile "/var/run/redis_6380.pid" loglevel notice logfile "" databases 16 save 900 1 save 300 10 save 60 10000 stop-writes-on-bgsave-error yes rdbcompression yes rdbchecksum yes dbfilename "dump.rdb" dir "/usr/local/redis_s/conf" slave-serve-stale-data yes slave-read-only yes repl-diskless-sync no repl-diskless-sync-delay 5 repl-disable-tcp-nodelay no slave-priority 100 appendonly no appendfilename "appendonly.aof" appendfsync everysec no-appendfsync-on-rewrite no auto-aof-rewrite-percentage 100 auto-aof-rewrite-min-size 64mb aof-load-truncated yes lua-time-limit 5000 slowlog-log-slower-than 10000 slowlog-max-len 128 latency-monitor-threshold 0 notify-keyspace-events "" hash-max-ziplist-entries 512 hash-max-ziplist-value 64 list-max-ziplist-size -2 list-compress-depth 0 set-max-intset-entries 512 zset-max-ziplist-entries 128 zset-max-ziplist-value 64 hll-sparse-max-bytes 3000 activerehashing yes client-output-buffer-limit normal 0 0 0 client-output-buffer-limit slave 256mb 64mb 60 client-output-buffer-limit pubsub 32mb 8mb 60 hz 10 aof-rewrite-incremental-fsync yes
-
每台机器都部署两个redis,重复上述操作。
- 部署完成在任意节点安装ruby环境
[root@redis01 src]# pwd /usr/local/src/redis-3.2.8/src [root@redis01 src]# cp redis-trib.rb /usr/local/bin/ [root@redis01 src]# yum -y install ruby ruby-devel rubygems rpm-build [root@redis01 src]# gem install redis --version 3.0.0 Fetching: redis-3.0.0.gem (100%) Successfully installed redis-3.0.0 Parsing documentation for redis-3.0.0 Installing ri documentation for redis-3.0.0 1 gem installed
#启动redis
[root@redis01 ~]# redis-server /usr/local/redis_m/conf/redis.conf [root@redis01 ~]# redis-server /usr/local/redis_s/conf/redis.conf [root@redis01 ~]# netstat -lntup|grep redis tcp 0 0 10.0.0.61:6379 0.0.0.0:* LISTEN 7226/redis-server 1 tcp 0 0 10.0.0.61:6380 0.0.0.0:* LISTEN 7230/redis-server 1 tcp 0 0 10.0.0.61:16379 0.0.0.0:* LISTEN 7226/redis-server 1 tcp 0 0 10.0.0.61:16380 0.0.0.0:* LISTEN 7230/redis-server 1
2 .1 创建集群
启动集群
[root@redis01 ~]# redis-trib.rb create --replicas 1 10.0.0.61:6379 10.0.0.62:6379 10.0.0.63:6379 10.0.0.61:6380 10.0.0.62:6380 10.0.0.63:6380 >>> Creating cluster ##省略 M: 7876243e1de6e81316ff299d0cbd9f50dee6a6a6 10.0.0.61:6379 slots:0-5460 (5461 slots) master 1 additional replica(s) M: 98b24b670b08b6f87c805d7225738b2119d1c1f3 10.0.0.63:6379 slots:10923-16383 (5461 slots) master 1 additional replica(s) S: 2f8dde5cfb03dd02331abf0560c3ab2e6fcfee0b 10.0.0.63:6380 slots: (0 slots) slave replicates 98b24b670b08b6f87c805d7225738b2119d1c1f3 S: a4212518794b6afacd9dc703a061bcba2ecd9683 10.0.0.62:6380 slots: (0 slots) slave replicates 7876243e1de6e81316ff299d0cbd9f50dee6a6a6 S: ce3105e44480c1c312918b01f6415767adc1e253 10.0.0.61:6380 slots: (0 slots) slave replicates c3d233cd5aa613b271e117c43a8d2a3f7702cdb5 M: c3d233cd5aa613b271e117c43a8d2a3f7702cdb5 10.0.0.62:6379 slots:5461-10922 (5462 slots) master 1 additional replica(s) [OK] All nodes agree about slots configuration. >>> Check for open slots... >>> Check slots coverage... [OK] All 16384 slots covered.
进入到集群
[root@redis01 ~]# redis-cli -h 10.0.0.61 -c -p 6379
查看cluster集群
[root@redis01 ~]# redis-trib.rb check 10.0.0.61:6379