• Kafka Offset相关命令总结


                    Kafka Offset相关命令总结

                                          作者:尹正杰

    版权声明:原创作品,谢绝转载!否则将追究法律责任。

    一.查询topic的offset的范围

    1>.查询某个topic的offset的最小值

    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -2         
    yinzhengjie:23:0            #很显然,第一列为topic名称,第二列为partition名称,第三列则是offset。为估计仔细的你应该已经发现了最小的offset为0,分区数为30个
    yinzhengjie:17:0
    yinzhengjie:8:0
    yinzhengjie:26:0
    yinzhengjie:11:0
    yinzhengjie:29:0
    yinzhengjie:2:0
    yinzhengjie:20:0
    yinzhengjie:5:0
    yinzhengjie:14:0
    yinzhengjie:4:0
    yinzhengjie:13:0
    yinzhengjie:22:0
    yinzhengjie:7:0
    yinzhengjie:16:0
    yinzhengjie:25:0
    yinzhengjie:10:0
    yinzhengjie:1:0
    yinzhengjie:28:0
    yinzhengjie:19:0
    yinzhengjie:27:0
    yinzhengjie:9:0
    yinzhengjie:18:0
    yinzhengjie:21:0
    yinzhengjie:3:0
    yinzhengjie:12:0
    yinzhengjie:15:0
    yinzhengjie:24:0
    yinzhengjie:6:0
    yinzhengjie:0:0
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -2 | wc -l
    30
    [root@node101.yinzhengjie.org.cn ~]#
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -2
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -2
    data.batch.ad:23:0
    data.batch.ad:8:0
    data.batch.ad:17:0
    data.batch.ad:26:0
    data.batch.ad:11:0
    data.batch.ad:29:0
    data.batch.ad:2:0
    data.batch.ad:20:0
    data.batch.ad:5:0
    data.batch.ad:14:0
    data.batch.ad:4:0
    data.batch.ad:13:0
    data.batch.ad:22:0
    data.batch.ad:7:0
    data.batch.ad:16:0
    data.batch.ad:25:0
    data.batch.ad:10:0
    data.batch.ad:1:0
    data.batch.ad:28:0
    data.batch.ad:19:0
    data.batch.ad:18:0
    data.batch.ad:27:0
    data.batch.ad:9:0
    data.batch.ad:3:0
    data.batch.ad:12:0
    data.batch.ad:21:0
    data.batch.ad:15:0
    data.batch.ad:6:0
    data.batch.ad:24:0
    data.batch.ad:0:0
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -1 |wc -l
    30
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -2

    2>.查询某个topic的offset的最大值

    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -1
    yinzhengjie:23:0
    yinzhengjie:17:0
    yinzhengjie:8:0
    yinzhengjie:26:0
    yinzhengjie:11:0
    yinzhengjie:29:0
    yinzhengjie:2:0
    yinzhengjie:20:0
    yinzhengjie:5:0
    yinzhengjie:14:0
    yinzhengjie:4:0
    yinzhengjie:13:0
    yinzhengjie:22:0
    yinzhengjie:7:0
    yinzhengjie:16:0
    yinzhengjie:25:0
    yinzhengjie:10:1
    yinzhengjie:1:1
    yinzhengjie:28:1
    yinzhengjie:19:0
    yinzhengjie:27:0
    yinzhengjie:9:0
    yinzhengjie:18:0
    yinzhengjie:21:0
    yinzhengjie:3:0
    yinzhengjie:12:0
    yinzhengjie:15:0
    yinzhengjie:24:0
    yinzhengjie:6:0
    yinzhengjie:0:0
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -1 | wc -l
    30
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -1
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -1
    data.batch.ad:23:49238022        #很明显,以冒号为分割,第一列为topic名称,第二列为partition 编号,第三列为当前最大的便宜量位置!
    data.batch.ad:8:49149404
    data.batch.ad:17:49170343
    data.batch.ad:26:49316398
    data.batch.ad:11:49346347
    data.batch.ad:29:49607820
    data.batch.ad:2:49061238
    data.batch.ad:20:49450860
    data.batch.ad:5:49247999
    data.batch.ad:14:48938440
    data.batch.ad:4:49174236
    data.batch.ad:13:49218393
    data.batch.ad:22:49384090
    data.batch.ad:7:49170708
    data.batch.ad:16:49288121
    data.batch.ad:25:49228190
    data.batch.ad:10:49318898
    data.batch.ad:1:49343856
    data.batch.ad:28:49569577
    data.batch.ad:19:48935100
    data.batch.ad:18:49223866
    data.batch.ad:27:49192217
    data.batch.ad:9:49038297
    data.batch.ad:3:49042016
    data.batch.ad:12:49329623
    data.batch.ad:21:49200748
    data.batch.ad:15:49426787
    data.batch.ad:6:48866851
    data.batch.ad:24:49559483
    data.batch.ad:0:49538864
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -1 | wc -l
    30
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -1

     

    二.查看consumer group列表,使用--list参数

       查看consumer group列表有新、旧两种命令,分别查看新版(信息保存在broker中)consumer列表和老版(信息保存在zookeeper中)consumer列表,因而需要区分指定bootstrap--server和zookeeper参数:(本片博客测试的kafka版本为0.10.2.1)

    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --zookeeper 10.1.2.114:2181 --list
    Note: This will only show information about consumers that use ZooKeeper (not those using the Java consumer API).        #很显然,为这里使用的是kafka 0.10.2.1版本,我们是查询不到对应的信息的!
    
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --zookeeper 10.1.2.114:2181 --list                #老版本的consumer信息都保存在zookeeper中,很显然,0.10.2.1这个版本已经将consumer信息自己保存啦!
    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --bootstrap-server 10.1.2.114:9092 --list            #查看新版consumer列表,很显然,我们可以查询到对应的数据
    Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers).
    
    id-data.batch.ad
    console-consumer-19829
    id-data.batch.env
    id-data.batch.er
    id-data.batch.pl
    console-consumer-89705
    id-data.batch.op
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --bootstrap-server 10.1.2.114:9092 --list            #查看新版consumer列表,很显然,我们可以查询到对应的数据

    三.查看指定group.id 的消费者消费情况 (kafka-consumer-groups.sh)

    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114:9092  --group id-data.batch.ad --describe
    Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers).
    
    
    TOPIC                          PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG        CONSUMER-ID                                       HOST                           CLIENT-ID
    data.batch.ad                  0          11429760        60611215        49181455   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  1          11363578        60437068        49073490   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  2          11347020        60122120        48775100   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  3          11398129        60102481        48704352   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  4          11375120        60212371        48837251   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  5          11384963        60221389        48836426   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  6          11375026        59769939        48394913   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  7          11394440        60151103        48756663   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  8          11405858        60116870        48711012   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  9          11398852        60044816        48645964   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  10         11371199        60338514        48967315   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  11         11407641        60304929        48897288   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  12         11417354        60378434        48961080   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  13         11385386        60333514        48948128   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  14         11353160        59954159        48600999   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  15         11445668        60630869        49185201   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  16         11376487        60375452        48998965   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  17         11405465        60245196        48839731   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  18         11406156        60222639        48816483   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  19         11380690        59987718        48607028   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  20         11436188        60585382        49149194   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  21         11421126        60222500        48801374   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  22         11428767        60506682        49077915   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  23         11385713        60308614        48922901   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  24         11416578        60688052        49271474   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  25         11412942        60235699        48822757   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  26         11403022        60389301        48986279   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  27         11402134        60223934        48821800   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  28         11422651        60658948        49236297   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    data.batch.ad                  29         11432147        60800417        49368270   consumer-1-53498a12-e62b-46c8-9c5c-ad97f807698d   /10.1.2.112                    consumer-1
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114:9092  --group id-data.batch.ad --describe | grep ad | wc -l
    Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers).
    
    30
    [root@node101.yinzhengjie.org.cn ~]# 
    
    简单对每列进行说明:
    
    TOPIC:
      消费者的topic名称  
    PARTITION:
      分区数的名称  
    
    CURRENT-OFFSET:
      consumer group最后一次提交的offset
    
    LOG-END-OFFSET:
      最后提交的生产消息offset
    LAG
      消费offset与生产offset之间的差值
    CONSUMER-ID
      消费者的ID编号,我们知道消费者组里面可以有最少要有一个消费者,当然也可以有多个消费者。
    HOST
      消费者的主机IP地址。
    CLIENT-ID
      链接的ID编号。
    [root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114:9092 --group id-data.batch.ad --describe

    四. 查询 __consumer_offsets topic 所有内容

    1>.运行下面命令前先要在consumer.properties中设置exclude.internal.topics=false

    [root@node101.yinzhengjie.org.cn ~]# cat /soft/kafka/config/consumer.properties 
    # Licensed to the Apache Software Foundation (ASF) under one or more
    # contributor license agreements.  See the NOTICE file distributed with
    # this work for additional information regarding copyright ownership.
    # The ASF licenses this file to You under the Apache License, Version 2.0
    # (the "License"); you may not use this file except in compliance with
    # the License.  You may obtain a copy of the License at
    # 
    #    http://www.apache.org/licenses/LICENSE-2.0
    # 
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS,
    # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    # See the License for the specific language governing permissions and
    # limitations under the License.
    # see kafka.consumer.ConsumerConfig for more details
    
    # Zookeeper connection string
    # comma separated host:port pairs, each corresponding to a zk
    # server. e.g. "127.0.0.1:3000,127.0.0.1:3001,127.0.0.1:3002"
    zookeeper.connect=127.0.0.1:2181
    
    # timeout in ms for connecting to zookeeper
    zookeeper.connection.timeout.ms=6000
    
    #consumer group id
    group.id=test-consumer-group
    
    #consumer timeout
    #consumer.timeout.ms=5000
    
    exclude.internal.topics=false
    [root@node101.yinzhengjie.org.cn ~]# 
    [root@node101.yinzhengjie.org.cn ~]# cat /soft/kafka/config/consumer.properties

    2>.0.11.0.0之前版本

    [root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114:9092 --formatter "kafka.coordinator.GroupMetadataManager$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning
    .......
    [0416-data.batch.ad,data.batch.ad,107]::[OffsetMetadata[9640759,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,103]::[OffsetMetadata[9479545,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,96]::[OffsetMetadata[9561634,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,116]::[OffsetMetadata[9643818,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,106]::[OffsetMetadata[9604096,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,102]::[OffsetMetadata[9509155,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,111]::[OffsetMetadata[9515197,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,99]::[OffsetMetadata[9475217,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,110]::[OffsetMetadata[9603634,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,108]::[OffsetMetadata[9836363,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,105]::[OffsetMetadata[9552080,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,101]::[OffsetMetadata[9623973,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,119]::[OffsetMetadata[9683087,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,98]::[OffsetMetadata[9326071,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,114]::[OffsetMetadata[9428070,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,115]::[OffsetMetadata[9578810,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,118]::[OffsetMetadata[9599649,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,100]::[OffsetMetadata[9612879,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,109]::[OffsetMetadata[9545059,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,97]::[OffsetMetadata[9508272,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,112]::[OffsetMetadata[9518640,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,113]::[OffsetMetadata[9700809,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,104]::[OffsetMetadata[9429872,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,117]::[OffsetMetadata[9588574,96ef03f3-528a-4354-9b56-7b98ea258ba4],CommitTime 1555468633718,ExpirationTime 1555555033718]
    [0416-data.batch.ad,data.batch.ad,1]::[OffsetMetadata[9632308,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,14]::[OffsetMetadata[9554051,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,11]::[OffsetMetadata[9650929,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,21]::[OffsetMetadata[9676355,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,5]::[OffsetMetadata[9453642,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,17]::[OffsetMetadata[9582307,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,4]::[OffsetMetadata[9517157,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,8]::[OffsetMetadata[9520614,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,20]::[OffsetMetadata[9571706,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,13]::[OffsetMetadata[9601455,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,23]::[OffsetMetadata[9559903,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,18]::[OffsetMetadata[9427121,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,2]::[OffsetMetadata[9427189,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,7]::[OffsetMetadata[9697701,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,12]::[OffsetMetadata[9648771,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,16]::[OffsetMetadata[9612199,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,0]::[OffsetMetadata[9597779,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,9]::[OffsetMetadata[9424049,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,3]::[OffsetMetadata[9475850,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    [0416-data.batch.ad,data.batch.ad,10]::[OffsetMetadata[9662179,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime 1555468633735,ExpirationTime 1555555033735]
    .......
    [root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114:9092 --formatter "kafka.coordinator.GroupMetadataManager$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning

    3>. 0.11.0.0之后版本(含)

     [root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114:9092 --formatter "kafka.coordinator.group.GroupMetadataManager$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning

    五.

    六.

  • 相关阅读:
    盲山有感
    一个用Regex的完成sql语句中字段替换的demo
    月夜奔跑
    乱弹
    《勇敢抉择》摘录一
    梦想高歌
    从今天起
    php性能优化
    unity3d shader中RenderType的所有类型
    Unity打包ipa图文教程
  • 原文地址:https://www.cnblogs.com/yinzhengjie/p/10514206.html
Copyright © 2020-2023  润新知