• 安装部署lightning


    环境:
    TIDB:V6.0.0
    OS:Centos 7

    192.168.1.118 pd,tidb,tikv,tiflash,monitoring,grafana,alertmanager,pump,drainer
    192.168.1.85 pd,tidb,tikv,tiflash,pump
    192.168.1.134 pd,tidb,tikv,pump

    1.安装
    [root@localhost components]# tiup install tidb-lightning
    安装完后有如下目录
    [root@localhost components]# ls
    cluster ctl dumpling tidb-lightning
    [root@localhost components]# pwd
    /root/.tiup/components

    2.导出数据库
    我这里导出db_test这个数据库
    /root/.tiup/components/dumpling/v6.0.0/dumpling -u root -p mysql -P 4000 -h 192.168.1.118 -B db_test --filetype sql -o /tmp/db_test


    3.尝试把导出的数据库删除掉
    mysql> drop database db_test;
    Query OK, 0 rows affected (1.10 sec)


    4.配置
    vi /tmp/tidb-lightning.toml
    内容如下:

    [lightning]
    # 日志
    level = "info"
    file = "tidb-lightning.log"
    
    [tikv-importer]
    # 选择使用的 local 后端
    backend = "local"
    # 设置排序的键值对的临时存放地址,目标路径需要是一个空目录
    sorted-kv-dir = "/tmp/sorted-kv-dir"
    
    [mydumper]
    # 源数据目录。
    data-source-dir = "/tmp/db_test/"
    
    # 配置通配符规则,默认规则会过滤 mysql、sys、INFORMATION_SCHEMA、PERFORMANCE_SCHEMA、METRICS_SCHEMA、INSPECTION_SCHEMA 系统数据库下的所有表
    # 若不配置该项,导入系统表时会出现“找不到 schema”的异常
    filter = ['*.*', '!mysql.*', '!sys.*', '!INFORMATION_SCHEMA.*', '!PERFORMANCE_SCHEMA.*', '!METRICS_SCHEMA.*', '!INSPECTION_SCHEMA.*']
    [tidb]
    # 目标集群的信息
    host = "192.168.1.118"
    port = 4000
    user = "root"
    password = "mysql"
    # 表架构信息在从 TiDB 的“状态端口”获取。
    status-port = 10080
    # 集群 pd 的地址,这里只写一个即可
    pd-addr = "192.168.1.118:2379"

    5.导入
    [root@localhost v6.0.0]# /root/.tiup/components/tidb-lightning/v6.0.0/tidb-lightning -config /tmp/tidb-lightning.toml
    Verbose debug logs will be written to tidb-lightning.log

    +---+----------------------------------------------+-------------+--------+
    | # | CHECK ITEM | TYPE | PASSED |
    +---+----------------------------------------------+-------------+--------+
    | 1 | Source csv files size is proper | performance | true |
    +---+----------------------------------------------+-------------+--------+
    | 2 | checkpoints are valid | critical | true |
    +---+----------------------------------------------+-------------+--------+
    | 3 | table schemas are valid | critical | true |
    +---+----------------------------------------------+-------------+--------+
    | 4 | Cluster is available | critical | true |
    +---+----------------------------------------------+-------------+--------+
    | 5 | Lightning has the correct storage permission | critical | true |
    +---+----------------------------------------------+-------------+--------+

    tidb lightning exit successfully

    6.检查导入的数据
    [root@localhost ~]# /opt/mysql5727/bin/mysql -h 192.168.1.134 -P4000 -uroot -p
    mysql> use db_test;
    mysql> show tables;
    +-------------------+
    | Tables_in_db_test |
    +-------------------+
    | tb_t1 |
    | tb_test |
    +-------------------+
    2 rows in set (0.00 sec)

    mysql> select count(1) from tb_test;
    +----------+
    | count(1) |
    +----------+
    | 1000000 |
    +----------+
    1 row in set (0.63 sec)

  • 相关阅读:
    大数据学习操作笔记
    每日总结
    每日总结
    每日总结
    每日总结
    每日总结
    每日总结
    jstl标签,c:foreach无效的问题
    阅读笔记
    《高效能人士的7个习惯》
  • 原文地址:https://www.cnblogs.com/hxlasky/p/16314226.html
Copyright © 2020-2023  润新知