• mycat 连续分片 -> 按日期(天)分片


    1,按日期(天)分片

    按日期(天)分片:从開始日期算起,依照天数来分片
    比如,从2016-01-01。每10天一个分片
    注意事项:须要提前将分片规划好,建好。否则有可能日期超出实际配置分片数


    2,加入配置文件

    在function.xml里面进行配置:

        <function name="sharding-by-date" class="org.opencloudb.route.function.PartitionByDate">
            <property name="dateFormat">yyyy-MM-dd</property>      <!-—日期格式-->
            <property name="sBeginDate">2016-01-01</property>            <!--開始日期-->
            <property name="sPartionDay">10</property>  <!--每分片天数-->
        </function>      
    
    
    
            <tableRule name="sharding-by-date-tr04">
                     <rule>
                             <columns>CREATE_TIME</columns>
                             <algorithm>sharding-by-date</algorithm>
                    </rule>
            </tableRule>
    

    在schema.xml里面进行配置:

        <table name="ORDER0402" primaryKey="ID" dataNode="dn21,dn22" rule="sharding-by-date-tr04"/>

    3。建表而且录入数据

        CREATE TABLE ORDER0402(ID INT NOT NULL AUTO_INCREMENT PRIMARY KEY,PROVINCE VARCHAR(16),SN VARCHAR(64),CREATE_TIME DATETIME);
        mysql> CREATE TABLE ORDER0402(ID INT NOT NULL AUTO_INCREMENT PRIMARY KEY,PROVINCE VARCHAR(16),SN VARCHAR(64),CREATE_TIME DATETIME);
        Query OK, 0 rows affected (0.05 sec)
    
        mysql> 
        INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(10001,'shanghai','shanghai10006_2016-01-03','2016-01-03');
        INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13');
        mysql> CREATE TABLE ORDER0402(ID INT NOT NULL AUTO_INCREMENT PRIMARY KEY,PROVINCE VARCHAR(16),SN VARCHAR(64),CREATE_TIME DATETIME);
        Query OK, 0 rows affected (0.06 sec)
    
        mysql> explain INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(10001,'shanghai','shanghai10006_2016-01-03','2016-01-03');
        +-----------+--------------------------------------------------------------------------------------------------------------------+
        | DATA_NODE | SQL                                                                                                                |
        +-----------+--------------------------------------------------------------------------------------------------------------------+
        | dn21      | INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(10001,'shanghai','shanghai10006_2016-01-03','2016-01-03') |
        +-----------+--------------------------------------------------------------------------------------------------------------------+
        1 row in set (0.11 sec)
    
        mysql> INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(10001,'shanghai','shanghai10006_2016-01-03','2016-01-03');
        Query OK, 1 row affected (0.00 sec)
    
        mysql> 
        mysql> explain INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13');
        +-----------+----------------------------------------------------------------------------------------------------------------------+
        | DATA_NODE | SQL                                                                                                                  |
        +-----------+----------------------------------------------------------------------------------------------------------------------+
        | dn22      | INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13') |
        +-----------+----------------------------------------------------------------------------------------------------------------------+
        1 row in set (0.01 sec)
    
        mysql> INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13');
        Query OK, 1 row affected (0.01 sec)
    
        mysql> 

    4,对insert操作流程进行分析,參考mycat.log对路由过程做完整的分析

    查看后台mycat.log分析例如以下:

    開始获取连接:
        02/12 22:23:26.386  DEBUG [$_NIOREACTOR-2-RW] (ServerQueryHandler.java:56) -ServerConnection [id=1, schema=TESTDB, host=127.0.0.1, user=test,txIsolation=3, autocommit=true, schema=TESTDB]INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13')
    
    開始路由匹配:
        02/12 22:23:26.388  DEBUG [$_NIOREACTOR-2-RW] (NonBlockingSession.java:113) -ServerConnection [id=1, schema=TESTDB, host=127.0.0.1, user=test,txIsolation=3, autocommit=true, schema=TESTDB]INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13'), route={
           1 -> dn22{INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13')}
    
    匹配好路由后,直接往相应的dn22节点開始运行insert数据录入操作:
        02/12 22:23:26.403  DEBUG [$_NIOREACTOR-1-RW] (NonBlockingSession.java:229) -release connection MySQLConnection [id=17, lastTime=1455287006372, user=root, schema=db3, old shema=db3, borrowed=true, fromSlaveDB=false, threadId=90, charset=latin1, txIsolation=3, autocommit=true, attachment=dn22{INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13')}, respHandler=SingleNodeHandler [node=dn22{INSERT INTO ORDER0402(ID,PROVINCE,SN,CREATE_TIME) VALUES(5000001,'shanghai','shanghai10006_2016-01-13','2016-01-13')}, packetId=0], host=13.23.1.11, port=3327, statusSync=null, writeQueue=0, modifiedSQLExecuted=true]
    
    操作完毕,開始释放连接:
        02/12 22:23:26.404  DEBUG [$_NIOREACTOR-1-RW] (PhysicalDatasource.java:403) -release channel MySQLConnection [id=17, lastTime=1455287006372, user=root, schema=db3, old shema=db3, borrowed=true, fromSlaveDB=false, threadId=90, charset=latin1, txIsolation=3, autocommit=true, attachment=null, respHandler=null, host=13.23.1.11, port=3327, statusSync=null, writeQueue=0, modifiedSQLExecuted=false]

    5,运行简单的查询,假设指定分片字段ID字段。则走分片查询单个分片节点

    mycat命令台显示结果:

        mysql>  explain select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03';
        +-----------+--------------------------------------------------------------------------+
        | DATA_NODE | SQL                                                                      |
        +-----------+--------------------------------------------------------------------------+
        | dn21      | SELECT * FROM ORDER0402 t1 WHERE t1.CREATE_TIME = '2016-01-03' LIMIT 100 |
        +-----------+--------------------------------------------------------------------------+
        1 row in set (0.04 sec)
    
        mysql> select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03';
        +-------+----------+--------------------------+---------------------+
        | ID    | PROVINCE | SN                       | CREATE_TIME         |
        +-------+----------+--------------------------+---------------------+
        | 10001 | shanghai | shanghai10006_2016-01-03 | 2016-01-03 00:00:00 |
        +-------+----------+--------------------------+---------------------+
        1 row in set (0.00 sec)
    
        mysql> 

    查看后台mycat日志信息:

        02/12 22:44:13.773  DEBUG [$_NIOREACTOR-2-RW] (ServerQueryHandler.java:56) -ServerConnection [id=1, schema=TESTDB, host=127.0.0.1, user=test,txIsolation=3, autocommit=true, schema=TESTDB]explain select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03'
        02/12 22:44:13.774  DEBUG [$_NIOREACTOR-2-RW] (EnchachePool.java:76) -SQLRouteCache  miss cache ,key:TESTDB select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03'
        02/12 22:44:13.812  DEBUG [$_NIOREACTOR-2-RW] (EnchachePool.java:59) -SQLRouteCache add cache ,key:TESTDB select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03' value:select * from ORDER0402 t1 where t1.CREATE_TIME='2016-01-03', route={
           1 -> dn21{SELECT *
        FROM ORDER0402 t1
        WHERE t1.CREATE_TIME = '2016-01-03'
        LIMIT 100}
        }

    6。假设分片字段范围的查询。则走全部节点去检索,哪怕仅仅有一条数据在一个分片上,route路由也是走全部的分片进行检索查询

        mysql> explain select * from ORDER0402 t1 where t1.CREATE_TIME<'2016-01-04';
        +-----------+--------------------------------------------------------------------------+
        | DATA_NODE | SQL                                                                      |
        +-----------+--------------------------------------------------------------------------+
        | dn21      | SELECT * FROM ORDER0402 t1 WHERE t1.CREATE_TIME < '2016-01-04' LIMIT 100 |
        | dn22      | SELECT * FROM ORDER0402 t1 WHERE t1.CREATE_TIME < '2016-01-04' LIMIT 100 |
        +-----------+--------------------------------------------------------------------------+
        2 rows in set (0.01 sec)
    
        mysql> 

    7,假设不走分片字段的查询,即使是单个数据,也要route路由全部的分片。走全部的分片进行查询

        mysql> explain select * from ORDER0402 t1 where t1.SN='shanghai10006_2016-01-03';
        +-----------+-------------------------------------------------------------------------------+
        | DATA_NODE | SQL                                                                           |
        +-----------+-------------------------------------------------------------------------------+
        | dn21      | SELECT * FROM ORDER0402 t1 WHERE t1.SN = 'shanghai10006_2016-01-03' LIMIT 100 |
        | dn22      | SELECT * FROM ORDER0402 t1 WHERE t1.SN = 'shanghai10006_2016-01-03' LIMIT 100 |
        +-----------+-------------------------------------------------------------------------------+
        2 rows in set (0.01 sec)
    
        mysql> 
  • 相关阅读:
    Java中的线程Thread方法之---interrupt() 分类: Android Java 2014-02-26 08:51 3189人阅读 评论(2) 收藏
    Java中的对象Object方法之---wait()和notifiy() 分类: Java Android 2014-02-26 08:50 1599人阅读 评论(0) 收藏
    Java中的线程Thread方法之---suspend()和resume() 分类: Java 2014-02-25 14:37 1650人阅读 评论(0) 收藏
    Java中的线程Thread方法之---join() 分类: Android Java 2014-02-25 13:38 1393人阅读 评论(0) 收藏
    Java中的线程Thread方法之---stop() 分类: Java 2014-02-25 09:59 3075人阅读 评论(1) 收藏
    抓包工具Fidder详解(主要来抓取Android中app的请求) 分类: Android 2014-02-24 09:32 10064人阅读 评论(5) 收藏
    XML的解析 分类: JavaWeb Java Android 2014-02-17 18:22 1764人阅读 评论(3) 收藏
    XML文件定义约束 分类: JavaWeb 2014-02-17 17:49 1127人阅读 评论(0) 收藏
    Android中的广播Broadcast详解 分类: Android 2014-02-13 10:59 8414人阅读 评论(5) 收藏
    GitHub错误处理:fatal:could not read Username for 'https://github.com': No such file or directory 分类: Java 2014-02-11 19:39 2346人阅读 评论(0) 收藏
  • 原文地址:https://www.cnblogs.com/yutingliuyl/p/7228026.html
Copyright © 2020-2023  润新知