• rpl_semi_sync_master_wait_no_slave 参数研究实验


    最近在研究MySQL,刚学到半同步。

    半同步的配置中,关于这两个参数:

      rpl_semi_sync_master_wait_no_slave

      rpl_semi_sync_master_wait_for_slave_count

    发现很不好搞懂,请教了一些老师,也做了一些资料搜索,每个人给我的答案都不同:

      

    中文网络上一些典型的说法,这些都是错误的!!!
    rpl_semi_sync_master_wait_for_slave_count:
      控制slave应答的数量,默认是1,表示master接收到几个slave应答后才commit。
       rpl_semi_sync_master_wait_no_slave :
      1.需要等待几个slave节点的ACK,否则一直waiting。
      2.当一个事务被提交,但是Master没有Slave连接,这时M不可能收到任何确认信息,但M会在时间限制范围内继续等待。如果没有Slave链接,会切换到异步复制。是否允许master每个事务提交后都要等待slave的接收确认信号。默认为on,每一个事务都会等待。如果为off,则slave追赶上后,也不会开启半同步复制模式,需要手工开启。

    好奇心驱使我通过实验来验证大家的说法,可惜的是——都是错的。通过官方文档,看的云里雾里的,只好自己探索。

     

    探索内容

      半同步参数

    • rpl_semi_sync_master_wait_no_slave(重点)
    • rpl_semi_sync_master_wait_for_slave_count

    环境信息

    role

    ip

    port

    hostname

    etc

    master

    192.168.188.101

    4306

    mysqlvm1

    提示符为mysql>

     

     

     

     

     

    slave

    192.168.188.201

    4306

    mysqlvm1-1

    提示符为mysql4306>

     

     

    5306

     

    提示符为mysql5306>

     

     

    6306

     

    提示符为mysql6306>

     

     

    7306

     

    提示符为mysql7306>

     

    MySQL版本

      5.7.26

     

    前置条件

      已配置好主从复制。

     

    配置增强半同步

      1.加载lib,所有主从节点都要配置。

        主库&从库:

    install plugin rpl_semi_sync_master soname 'semisync_master.so';
    
    install plugin rpl_semi_sync_slave soname 'semisync_slave.so';   

          

      2.查看,确保所有节点都成功加载。

        mysql> show plugins;
    
          | rpl_semi_sync_master       | ACTIVE   | REPLICATION        | semisync_master.so | GPL     |
    
          | rpl_semi_sync_slave        | ACTIVE   | REPLICATION        | semisync_slave.so  | GPL     |

     

      3.启用半同步

        1.先启用从库上的参数,最后启用主库的参数。

        从库:

    set global rpl_semi_sync_slave_enabled = 1;   # 1:启用,0:禁止

        主库:

            

    set global rpl_semi_sync_master_enabled = 1;   # 1:启用,0:禁止
    
    set global rpl_semi_sync_master_timeout = 60000;       # 60秒,时间长些便于实验

        2.从库重启io_thread

        stop slave io_thread;
    
        start slave io_thread;

        查看主库参数

          

    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | binlog_group_commit_sync_delay            | 100        |
    | binlog_group_commit_sync_no_delay_count   | 10         |
    | innodb_flush_sync                         | ON         |
    | innodb_sync_array_size                    | 1          |
    | innodb_sync_spin_loops                    | 30         |
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_trace_level          | 32         |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | ON         |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    | rpl_semi_sync_slave_trace_level           | 32         |
    | sync_binlog                               | 1          |
    | sync_frm                                  | ON         |
    | sync_master_info                          | 10000      |
    | sync_relay_log                            | 10000      |
    | sync_relay_log_info                       | 10000      |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
     
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Innodb_data_fsyncs                         | 664      |
    | Innodb_data_pending_fsyncs                 | 0        |
    | Innodb_os_log_fsyncs                       | 413      |
    | Innodb_os_log_pending_fsyncs               | 0        |
    | Rpl_semi_sync_master_clients               | 4        |
    | Rpl_semi_sync_master_net_avg_wait_time     | 0        |
    | Rpl_semi_sync_master_net_wait_time         | 0        |
    | Rpl_semi_sync_master_net_waits             | 199      |
    | Rpl_semi_sync_master_no_times              | 21       |
    | Rpl_semi_sync_master_no_tx                 | 48       |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_master_timefunc_failures     | 0        |
    | Rpl_semi_sync_master_tx_avg_wait_time      | 3280008  |
    | Rpl_semi_sync_master_tx_wait_time          | 72160195 |
    | Rpl_semi_sync_master_tx_waits              | 22       |
    | Rpl_semi_sync_master_wait_pos_backtraverse | 0        |
    | Rpl_semi_sync_master_wait_sessions         | 0        |
    | Rpl_semi_sync_master_yes_tx                | 20       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    
    19 rows in set (0.00 sec)

     

    ============================我是分割线=====================================

     

     

    实验1

    场景:

      rpl_semi_sync_master_wait_no_slave=ON

      rpl_semi_sync_master_wait_for_slave_count=3

      slave存活1,其他slave停止,会发生什么?

    步骤:

      1.只保留一个slave,停止其他3个slave

    mysql5306> stop slave;
    mysql6306> stop slave;
    mysql7306> stop slave;

      2.立即查询master

        为减少信息干扰,只截取了需要关注的数据

    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | ON         |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
     
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 4        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

      3.等待一分钟,再查询master

    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | ON         |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
     
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 1        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)
    
     

      4.另外开启一个master会话,开始一个事务并提交

    mysql> insert into new values(4);
    [挂起……]

      5.查看master

        发现无变化

    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | ON         |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
     
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 1        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

      6.查看存活的slave

        发现事务已经被应用

    mysql> select * from new;
    
    +------+
    | name |
    +------+
    |    2 |
    +------+
    1 rows in set (0.00 sec)

     

      7.等待master事务超时后完成。

         这里master提交到收到结果,用了1分钟0.01秒,该事务因slave的ack应答不够,发生了等待。

    mysql> insert into new values(4);
    Query OK, 1 row affected (1 min 0.01 sec)

     

      8.查看master

        可以发现,事务超时后,master已经转为异步复制(Rpl_semi_sync_master_status=OFF)

     

    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | ON         |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
     
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 1        |
    | Rpl_semi_sync_master_status                | OFF      |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

      9.依次启动已经停止的slave,每启动一个,便立即查看一次master状态

        可以看到,启动slave的动作会立即被master接收到,并且master会自动切换回半同步模式(Rpl_semi_sync_master_status=ON)

     

    mysql5306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 2        |
    | Rpl_semi_sync_master_status                | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)
    
     
    
    mysql6306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 3        |
    | Rpl_semi_sync_master_status                | ON       |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)
    
     
    
    mysql7306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 4        |
    | Rpl_semi_sync_master_status                | ON       |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

    ============================我是分割线=====================================

     

    实验2

    场景:

      rpl_semi_sync_master_wait_no_slave=OFF

      rpl_semi_sync_master_wait_for_slave_count=3

      slave存活1,其他slave停止,会发生什么?

    步骤:

      1.继续实验1的环境,首先设置参数并查看master状态

        为减少信息干扰,只截取了需要关注的数据 

    mysql> set global rpl_semi_sync_master_wait_no_slave=OFF;
    Query OK, 0 rows affected (0.00 sec)
    
    mysql> show global variables like "%sync%"; show global status like "%sync%";
    
    +-------------------------------------------+------------+
    | Variable_name                             | Value      |
    +-------------------------------------------+------------+
    | rpl_semi_sync_master_enabled              | ON         |
    | rpl_semi_sync_master_timeout              | 60000      |
    | rpl_semi_sync_master_wait_for_slave_count | 3          |
    | rpl_semi_sync_master_wait_no_slave        | OFF        |
    | rpl_semi_sync_master_wait_point           | AFTER_SYNC |
    | rpl_semi_sync_slave_enabled               | ON         |
    +-------------------------------------------+------------+
    18 rows in set (0.00 sec)
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 4        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

      2.只保留一个slave,依次停止其他3个slave

    mysql5306> stop slave;
    mysql6306> stop slave;
    mysql7306> stop slave;

     

      3.等待一分钟,查看master状态。(在等待期间可以通过反复查看master状态,来观察master数据的变化)

        master已经转为异步模式复制。 

    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 1        |
    | Rpl_semi_sync_master_status                | OFF      |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

      4.使用另一个master的会话,开始一个事务并提交。 这里master提交到收到结果,该事务没有发生等待。

    mysql> insert into new values(5);
    Query OK, 1 row affected (0.02 sec)

     

      5.立即查看存活的slave

         事务已经被应用。

    mysql> select * from new;
    
    +------+
    | name |
    +------+
    |    4 |
    |    5 |
    +------+
    2 rows in set (0.00 sec)

     

      6.依次启动其他slave,每启动一个便立即查看master状态

        可以看到,启动slave的动作会立即被master接收到,并且master会自动切换回半同步模式(Rpl_semi_sync_master_status=ON)

    mysql5306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 2        |
    | Rpl_semi_sync_master_status                | OFF      |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)
    
     
    
    mysql6306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 3        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)
    
     
    
    mysql7306> start slave;
    
    mysql> show global status like "%sync%";
    
    +--------------------------------------------+----------+
    | Variable_name                              | Value    |
    +--------------------------------------------+----------+
    | Rpl_semi_sync_master_clients               | 4        |
    | Rpl_semi_sync_master_status                | ON       |
    | Rpl_semi_sync_slave_status                 | OFF      |
    +--------------------------------------------+----------+
    19 rows in set (0.00 sec)

     

    ============================我是分割线=====================================

    结论:

    使用直白简短好理解的语言:

     

    【rpl_semi_sync_master_wait_for_slave_count】

      1.master提交后所需的应答数量!如果slave clients数量大于等于这个值,那么master会一路畅行无阻;如果低于这个值,master可能会在事务提交阶段发生一次超时等待,当等待超过参数(rpl_semi_sync_master_timeout)设定时,master就转为异步模式(原理见下一个参数)。

      2.master将这个参数值作为标杆,用来和【Rpl_semi_sync_master_clients】参数做比较。

    【rpl_semi_sync_master_wait_no_slave】

      1.为OFF时,只要master发现【Rpl_semi_sync_master_clients】小于【rpl_semi_sync_master_wait_for_slave_count】,则master立即转为异步模式。

      2.为ON时,空闲时间(无事务提交)里,即使master发现【Rpl_semi_sync_master_clients】小于【rpl_semi_sync_master_wait_for_slave_count】,也不会做任何调整。只要保证在事务超时之前,master收到大于等于【rpl_semi_sync_master_wait_for_slave_count】值的ACK应答数量,master就一直保持在半同步模式;如果在事务提交阶段(master等待ACK)超时,master才会转为异步模式。

     

    无论【rpl_semi_sync_master_wait_no_slave】为ON还是OFF,当slave上线到【rpl_semi_sync_master_wait_for_slave_count】值时,master都会自动由异步模式转为半同步模式。

     

    粗略看来,设置为OFF时,master不会因为slave的离线而造成事务等待,这似乎是一个更合适的选择,但是为什么5.7中默认参数为ON呢?目前我还不得而知。

    另外,本次实验建立在空闲场景(或者说极微小负载场景)下,在高并发的场景下,这个参数又会导致怎样的结果,这块也尚需后续探索。

     

     

     ============================我是分割线=====================================

    官方文档关于参数rpl_semi_sync_master_wait_no_slave的解释:

     

    Controls whether the master waits for the timeout period configured by rpl_semi_sync_master_timeout to expire, even if the slave count drops to less than the number of slaves configured by pl_semi_sync_master_wait_for_slave_count during the timeout period.

     

    When the value of rpl_semi_sync_master_wait_no_slave is ON (the default), it is permissible for the slave count to drop to less than rpl_semi_sync_master_wait_for_slave_count during the timeout period. As long as enough slaves acknowledge the transaction before the timeout period expires, semisynchronous replication continues.

     

    When the value of rpl_semi_sync_master_wait_no_slave is OFF, if the slave count drops to less than the number configured in rpl_semi_sync_master_wait_for_slave_count at any time during the timeout period configured by rpl_semi_sync_master_timeout, the master reverts to normal replication.

     

    This variable is available only if the master-side semisynchronous replication plugin is installed.

     

    官方文档关于参数rpl_semi_sync_master_wait_for_slave_count的解释:

     

    The number of slave acknowledgments the master must receive per transaction before proceeding. By default rpl_semi_sync_master_wait_for_slave_count is 1, meaning that semisynchronous replication proceeds after receiving a single slave acknowledgment. Performance is best for small values of this variable.

     

    For example, if rpl_semi_sync_master_wait_for_slave_count is 2, then 2 slaves must acknowledge receipt of the transaction before the timeout period configured by rpl_semi_sync_master_timeout for semisynchronous replication to proceed. If less slaves acknowledge receipt of the transaction during the timeout period, the master reverts to normal replication.

     

     

    ============================我是结束线=====================================

    EOF

  • 相关阅读:
    Android实现通过浏览器点击链接打开本地应用(APP)并拿到浏览器传递的数据(转)
    保存图片文件到本地
    android ScrollView中嵌套GridView,ListView只显示一行的解决办法
    蒙版提示页(添加新功能后的一种提示)
    C和指针 第三章--数据
    *(ptr++) += 123
    优先级队列-堆
    单链表相关(一)
    字符间的距离-动态规划
    和最大的连续子数组
  • 原文地址:https://www.cnblogs.com/konggg/p/12205505.html
Copyright © 2020-2023  润新知