• logstash-input-jdbc 同时同步多个表的情况


    input {
        jdbc {
          jdbc_connection_string => "jdbc:mysql://localhost:3306/crm?zeroDateTimeBehavior=convertToNull"
          jdbc_user => "root"
          jdbc_password => ""
          jdbc_driver_library => "D:/siyang/elasticsearch-5.2.2/logstash-5.2.2/mysql-connector-java-5.1.30.jar"
          jdbc_driver_class => "com.mysql.jdbc.Driver"
          jdbc_paging_enabled => "true"
          jdbc_page_size => "50000"
          statement_filepath => "filename.sql"
          schedule => "* * * * *"
          type => "jdbc_office"
        }
        jdbc {
          jdbc_connection_string => "jdbc:mysql://localhost:3306/crm?zeroDateTimeBehavior=convertToNull"
          jdbc_user => "root"
          jdbc_password => "" 
          jdbc_driver_library => "D:/siyang/elasticsearch-5.2.2/logstash-5.2.2/mysql-connector-java-5.1.30.jar"
          jdbc_driver_class => "com.mysql.jdbc.Driver"
          jdbc_paging_enabled => "true"
          jdbc_page_size => "50000"
          statement => "SELECT * from sys_user"
          schedule => "* * * * *"
          type => "jdbc_user"
        }
    }
    output {
     stdout {
            codec => json_lines
        }
        if[type] == "jdbc_office"{
            elasticsearch {
            hosts  => "localhost:9200"
            index => "contacts4"
            document_type => "office1"
            document_id => "%{id}"
            }
        }
        if[type] == "jdbc_user"{
            elasticsearch {
            hosts  => "localhost:9200"
            index => "contacts4"
            document_type => "user1"
            document_id => "%{id}"
            }
        }
    }

    注意事项,数据库里面的字段不要用type,如果有,as成其他的名字,不然的话,这里判断会有异常

  • 相关阅读:
    关于js的语句类型运算符等
    关于flex的布局理解
    三天来都在写项目;今天开始学习了js
    12.13的学习内容
    Css多列语法笔记
    Css3关键帧动画
    codevs1085数字游戏(环形DP+划分DP )
    codevs1040统计单词个数(区间+划分型dp)
    POJ1062昂贵的聘礼
    POJ3687Labeling Balls
  • 原文地址:https://www.cnblogs.com/tu6ge/p/7843510.html
Copyright © 2020-2023  润新知