一、主从复制搭建(新环境5.6.33)
1、设置复制Master配置信息
[mysqld] #repl master库 server-id=6 log-bin=E:MySQL4306logbinmysql-bin max_binlog_size=100M binlog-format=MIXED
2、启动Master实例
3、Master实例上创建一个用于复制的帐户
mysql> use `mysql`; mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'localhost' IDENTIFIED BY 'repl';
4、获取Master状态信息
#在session1锁表 mysql> FLUSH TABLES WITH READ LOCK; #在session2查看状态 mysql > SHOW MASTER STATUS;
5、在Master上释放读锁
mysql> UNLOCK TABLES;
6、在Slave上编辑配置信息
[mysqld] #repl slave库 server-id=7 relay_log=E:MySQL4307logbinmysql-relay-bin
7、启动Slave实例
8、在Slave上设置Master配置
mysql> change master to master_host='127.0.0.1', master_port=4306, master_user='repl', master_password='repl', master_log_file='mysql-bin.000001', master_log_pos=331;
二、Mycat搭建
Mycat、Mycat-eye依赖jdk1.7+环境
1、JDK下载安装(jdk-7u80-windows-i586.exe),并配置环境变量
新创建环境变量(变量名+变量值) JAVA_HOME D:Javajdk1.7.0_80 Classpath .;%JAVA_HOME%lib;%JAVA_HOME%lib ools.jar MYCAT_HOME D:MySQLSoftwaremycat PATH添加值 ;%JAVA_HOME%in;%JAVA_HOME%jrein;%MYCAT_HOME%in
设置环境变量后cmd运行
java -version
2、Mycat解压(Mycat-server-1.6-RELEASE-20161028204710-win.tar.gz),运行startup_nowrap.bat
rem startup_nowrap.bat REM check JAVA_HOME & java set "JAVA_CMD=%JAVA_HOME%injava" if "%JAVA_HOME%" == "" goto noJavaHome if exist "%JAVA_HOME%injava.exe" goto mainEntry :noJavaHome echo --------------------------------------------------- echo WARN: JAVA_HOME environment variable is not set. echo --------------------------------------------------- set "JAVA_CMD=java" :mainEntry REM set HOME_DIR set "CURR_DIR=%cd%" cd .. set "MYCAT_HOME=%cd%" cd %CURR_DIR% "%JAVA_CMD%" -server -Xms512M -Xmx1024M -XX:MaxPermSize=64M -XX:+AggressiveOpts -XX:MaxDirectMemorySize=1G -DMYCAT_HOME=%MYCAT_HOME% -cp "..conf;..lib*" io.mycat.MycatStartup pause
如果执行报java命令错误,可修改批处理中的变量为实例对象;内存不充足时可适当调整Xms、Xmx的大小。这种方式一般是在程序运行有问题时选用。
前面已经将Mycat添加到环境变量(不然要切换到对应目录),可以在cmd下直接执行mycat
装载、启动服务
#装载成服务 mycat install #启动服务 mycat start
首次启动
STATUS | wrapper | 2017/03/02 14:09:26 | Starting the Mycat-server service... STATUS | wrapper | 2017/03/02 14:09:26 | --> Wrapper Started as Service STATUS | wrapper | 2017/03/02 14:09:27 | Launching a JVM... INFO | jvm 1 | 2017/03/02 14:09:27 | Error: missing `server' JVM at `D:Javajre7inserverjvm.dll'. INFO | jvm 1 | 2017/03/02 14:09:27 | Please install or use the JRE or JDK that contains these missing components. ERROR | wrapper | 2017/03/02 14:09:27 | JVM exited while loading the application. STATUS | wrapper | 2017/03/02 14:09:31 | Launching a JVM... INFO | jvm 2 | 2017/03/02 14:09:31 | Error: missing `server' JVM at `D:Javajre7inserverjvm.dll'. INFO | jvm 2 | 2017/03/02 14:09:31 | Please install or use the JRE or JDK that contains these missing components. ERROR | wrapper | 2017/03/02 14:09:31 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:09:31 | Waiting to start... STATUS | wrapper | 2017/03/02 14:09:35 | Launching a JVM... INFO | jvm 3 | 2017/03/02 14:09:36 | Error: missing `server' JVM at `D:Javajre7inserverjvm.dll'. INFO | jvm 3 | 2017/03/02 14:09:36 | Please install or use the JRE or JDK that contains these missing components. ERROR | wrapper | 2017/03/02 14:09:36 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:09:36 | Waiting to start... STATUS | wrapper | 2017/03/02 14:09:40 | Launching a JVM... INFO | jvm 4 | 2017/03/02 14:09:40 | Error: missing `server' JVM at `D:Javajre7inserverjvm.dll'. INFO | jvm 4 | 2017/03/02 14:09:40 | Please install or use the JRE or JDK that contains these missing components. ERROR | wrapper | 2017/03/02 14:09:40 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:09:41 | Waiting to start... STATUS | wrapper | 2017/03/02 14:09:44 | Launching a JVM... INFO | jvm 5 | 2017/03/02 14:09:44 | Error: missing `server' JVM at `D:Javajre7inserverjvm.dll'. INFO | jvm 5 | 2017/03/02 14:09:44 | Please install or use the JRE or JDK that contains these missing components. ERROR | wrapper | 2017/03/02 14:09:44 | JVM exited while loading the application. FATAL | wrapper | 2017/03/02 14:09:44 | There were 5 failed launches in a row, each lasting less than 300 seconds. Giving up. FATAL | wrapper | 2017/03/02 14:09:44 | There may be a configuration problem: please check the logs. STATUS | wrapper | 2017/03/02 14:09:44 | <-- Wrapper Stopped ERROR | wrapper | 2017/03/02 14:09:45 | The Mycat-server service was launched, but failed to start.
将mycatconfwrapper.conf中的wrapper.java.command=java
修改为wrapper.java.command=D:Javajdk1.7.0_80injava.exe
再次启动
STATUS | wrapper | 2017/03/02 14:11:08 | Starting the Mycat-server service... STATUS | wrapper | 2017/03/02 14:11:08 | --> Wrapper Started as Service STATUS | wrapper | 2017/03/02 14:11:09 | Launching a JVM... INFO | jvm 1 | 2017/03/02 14:11:11 | Error: Could not create the Java Virtual Machine. INFO | jvm 1 | 2017/03/02 14:11:11 | Error: A fatal exception has occurred. Program will exit. INFO | jvm 1 | 2017/03/02 14:11:11 | Invalid maximum heap size: -Xmx4G INFO | jvm 1 | 2017/03/02 14:11:11 | The specified size exceeds the maximum representable size. ERROR | wrapper | 2017/03/02 14:11:11 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:11:13 | Waiting to start... STATUS | wrapper | 2017/03/02 14:11:15 | Launching a JVM... INFO | jvm 2 | 2017/03/02 14:11:15 | Error: Could not create the Java Virtual Machine. INFO | jvm 2 | 2017/03/02 14:11:15 | Error: A fatal exception has occurred. Program will exit. INFO | jvm 2 | 2017/03/02 14:11:15 | Invalid maximum heap size: -Xmx4G INFO | jvm 2 | 2017/03/02 14:11:15 | The specified size exceeds the maximum representable size. ERROR | wrapper | 2017/03/02 14:11:15 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:11:18 | Waiting to start... STATUS | wrapper | 2017/03/02 14:11:19 | Launching a JVM... INFO | jvm 3 | 2017/03/02 14:11:20 | Error: Could not create the Java Virtual Machine. INFO | jvm 3 | 2017/03/02 14:11:20 | Error: A fatal exception has occurred. Program will exit. INFO | jvm 3 | 2017/03/02 14:11:20 | Invalid maximum heap size: -Xmx4G INFO | jvm 3 | 2017/03/02 14:11:20 | The specified size exceeds the maximum representable size. ERROR | wrapper | 2017/03/02 14:11:20 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:11:23 | Waiting to start... STATUS | wrapper | 2017/03/02 14:11:24 | Launching a JVM... INFO | jvm 4 | 2017/03/02 14:11:24 | Error: Could not create the Java Virtual Machine. INFO | jvm 4 | 2017/03/02 14:11:24 | Error: A fatal exception has occurred. Program will exit. INFO | jvm 4 | 2017/03/02 14:11:24 | Invalid maximum heap size: -Xmx4G INFO | jvm 4 | 2017/03/02 14:11:24 | The specified size exceeds the maximum representable size. ERROR | wrapper | 2017/03/02 14:11:24 | JVM exited while loading the application. STATUS | wrapper | 2017/03/02 14:11:28 | Launching a JVM... INFO | jvm 5 | 2017/03/02 14:11:28 | Error: Could not create the Java Virtual Machine. INFO | jvm 5 | 2017/03/02 14:11:28 | Error: A fatal exception has occurred. Program will exit. INFO | jvm 5 | 2017/03/02 14:11:28 | Invalid maximum heap size: -Xmx4G INFO | jvm 5 | 2017/03/02 14:11:28 | The specified size exceeds the maximum representable size. ERROR | wrapper | 2017/03/02 14:11:28 | JVM exited while loading the application. INFO | wrapper | 2017/03/02 14:11:28 | Waiting to start... FATAL | wrapper | 2017/03/02 14:11:28 | There were 5 failed launches in a row, each lasting less than 300 seconds. Giving up. FATAL | wrapper | 2017/03/02 14:11:28 | There may be a configuration problem: please check the logs. STATUS | wrapper | 2017/03/02 14:11:28 | <-- Wrapper Stopped ERROR | wrapper | 2017/03/02 14:11:30 | The Mycat-server service was launched, but failed to start.
Invalid maximum heap size: -Xmx4G,将-Xmx4G数值适当调低些,再次启动成功。
mycat console界面类似mycatinstartup_nowrap.bat,不过后者不会创建JVM。
适当修改schema.xml、server.xml、rule.xml,然后就可以启动Mycat啦。下面的schema.xml(注意server.xml中的</user>栏中的schemas属性要保持一致)是针对MySQL主从复制,开启Mycat的读写分离功能。4306写入,4307读取
<?xml version="1.0"?> <!DOCTYPE mycat:schema SYSTEM "schema.dtd"> <mycat:schema xmlns:mycat="http://io.mycat/"> <schema name="sakila" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn1"> <!-- <table name="oc_call" primaryKey="ID" dataNode="dn1$0-743" rule="latest-month-calldate" /> --> </schema> <dataNode name="dn1" dataHost="localhost1" database="sakila" /> <!-- <dataNode name="dn1$0-743" dataHost="localhost1" database="db$0-743" /> --> <dataHost name="localhost1" maxCon="1000" minCon="10" balance="1" writeType="0" dbType="mysql" dbDriver="native" switchType="-1" slaveThreshold="100"> <heartbeat>show slave status</heartbeat> <!-- can have multi write hosts --> <writeHost host="hostM1" url="localhost:4306" user="root" password="mysql4306"> <!-- can have multi read hosts --> <!--<readHost host="hostS2" url="192.168.1.200:3306" user="root" password="xxx" />--> </writeHost> <writeHost host="hostS1" url="localhost:4307" user="root" password="mysql4307" /> <!-- <writeHost host="hostM2" url="localhost:3316" user="root" password="123456"/> --> </dataHost> </mycat:schema>
4306结点宕机后不会切换(switchType="-1")到4307结点,但4307能继续提供读取功能。如果4307结点宕机,读写将全部在4306结点。
下面这个schema.xml使用Mycat进行分片
<?xml version="1.0"?> <!DOCTYPE mycat:schema SYSTEM "schema.dtd"> <mycat:schema xmlns:mycat="http://io.mycat/"> <schema name="mycatdb" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn1"> <!-- auto sharding by id (long) --> <table name="travelrecord" dataNode="dn$1-3" rule="auto-sharding-long" /> <!-- global table is auto cloned to all defined data nodes ,so can join with any table whose sharding node is in the same data node --> <table name="company" primaryKey="ID" type="global" dataNode="dn1,dn2,dn3" /> <table name="goods" primaryKey="ID" type="global" dataNode="dn1,dn2" /> <!-- random sharding using mod sharind rule --> <table name="hotnews" primaryKey="ID" autoIncrement="true" dataNode="dn1,dn2,dn3" rule="mod-long" /> <!-- <table name="dual" primaryKey="ID" dataNode="dnx,dnoracle2" type="global" needAddLimit="false"/> <table name="worker" primaryKey="ID" dataNode="jdbc_dn1,jdbc_dn2,jdbc_dn3" rule="mod-long" /> --> <table name="employee" primaryKey="ID" dataNode="dn1,dn2" rule="sharding-by-intfile" /> <table name="customer" primaryKey="ID" dataNode="dn1,dn2" rule="sharding-by-intfile"> <childTable name="orders" primaryKey="ID" joinKey="customer_id" parentKey="id"> <childTable name="order_items" joinKey="order_id" parentKey="id" /> </childTable> <childTable name="customer_addr" primaryKey="ID" joinKey="customer_id" parentKey="id" /> </table> <!-- <table name="oc_call" primaryKey="ID" dataNode="dn1$0-743" rule="latest-month-calldate" /> --> </schema> <schema name="sakila" checkSQLschema="false" sqlMaxLimit="100" dataNode="dn4"> <!-- <table name="oc_call" primaryKey="ID" dataNode="dn1$0-743" rule="latest-month-calldate" /> --> </schema> <!-- <dataNode name="dn1$0-743" dataHost="localhost1" database="db$0-743" /> --> <dataNode name="dn$1-3" dataHost="localhost1" database="mycatdb$1-3" /> <dataNode name="dn4" dataHost="localhost1" database="sakila" /> <!--<dataNode name="dn4" dataHost="sequoiadb1" database="SAMPLE" /> <dataNode name="jdbc_dn1" dataHost="jdbchost" database="db1" /> <dataNode name="jdbc_dn2" dataHost="jdbchost" database="db2" /> <dataNode name="jdbc_dn3" dataHost="jdbchost" database="db3" /> --> <dataHost name="localhost1" maxCon="1000" minCon="10" balance="1" writeType="0" dbType="mysql" dbDriver="native" switchType="-1" slaveThreshold="100"> <heartbeat>select user()</heartbeat> <!-- can have multi write hosts --> <writeHost host="hostM1" url="localhost:4306" user="root" password="mysql4306"> <!-- can have multi read hosts --> <!--<readHost host="hostS2" url="192.168.1.200:3306" user="root" password="xxx" />--> </writeHost> <writeHost host="hostS1" url="localhost:4307" user="root" password="mysql4307" /> <!-- <writeHost host="hostM2" url="localhost:3316" user="root" password="123456"/> --> </dataHost> <!-- <dataHost name="sequoiadb1" maxCon="1000" minCon="1" balance="0" dbType="sequoiadb" dbDriver="jdbc"> <heartbeat> </heartbeat> <writeHost host="hostM1" url="sequoiadb://1426587161.dbaas.sequoialab.net:11920/SAMPLE" user="jifeng" password="jifeng"></writeHost> </dataHost> <dataHost name="oracle1" maxCon="1000" minCon="1" balance="0" writeType="0" dbType="oracle" dbDriver="jdbc"> <heartbeat>select 1 from dual</heartbeat> <connectionInitSql>alter session set nls_date_format='yyyy-mm-dd hh24:mi:ss'</connectionInitSql> <writeHost host="hostM1" url="jdbc:oracle:thin:@127.0.0.1:1521:nange" user="base" password="123456" > </writeHost> </dataHost> <dataHost name="jdbchost" maxCon="1000" minCon="1" balance="0" writeType="0" dbType="mongodb" dbDriver="jdbc"> <heartbeat>select user()</heartbeat> <writeHost host="hostM" url="mongodb://192.168.0.99/test" user="admin" password="123456" ></writeHost> </dataHost> <dataHost name="sparksql" maxCon="1000" minCon="1" balance="0" dbType="spark" dbDriver="jdbc"> <heartbeat> </heartbeat> <writeHost host="hostM1" url="jdbc:hive2://feng01:10000" user="jifeng" password="jifeng"></writeHost> </dataHost> --> <!-- <dataHost name="jdbchost" maxCon="1000" minCon="10" balance="0" dbType="mysql" dbDriver="jdbc"> <heartbeat>select user()</heartbeat> <writeHost host="hostM1" url="jdbc:mysql://localhost:3306" user="root" password="123456"> </writeHost> </dataHost> --> </mycat:schema>
三、Mycat-Web
1、Zookeeper配置
Mycat-eye需要Zookeeper作为配置中心
1.1、解压zookeeper-3.4.8.tar.gz
1.2、zookeeper-3.4.8conf目录下把zoo_sample.cfg修改为zoo.cfg
1.3、启动zookeeper
Windowns版本:zookeeper-3.4.6inzkServer.bat
2、Mycat-eye部署
2.1、解压Mycat-web-1.0-SNAPSHOT-20160617163048-win.zip
2.2、先启动Zookeeper
2.3、启动Mycat-eye
Windowns版本:mycat-webstart.bat
2.4、访问Mycat-eye
http://localhost:8082/mycat/
mycat.properties配置:mycat-webmycat-webWEB-INFclassesmycat.properties