kafkactl工具使用

kafkactl工具使用

(1.) 下载安装

# 根据不同操作系统，下载不同的版本
https://github.com/deviceinsight/kafkactl/releases

# 安装
rpm -ivh *.rpm

# 查看
kafkactl -h

# windows二进制直接运行，只需修改配置即可
C:\Users\Administrator\.config\kafkactl\config.yml

(2.) 配置

vi /root/.config/kafkactl/config.yml
contexts:
  # default context without SASL
  remote-cluster:
    brokers:
      - 192.168.1.10:9092
    requestTimeout: 15s
    kafkaversion: 2.8.1
    # optional: tls config
    tls:
      enabled: false
      ca: my-ca
      cert: my-cert
      certKey: my-key
      # set insecure to true to ignore all tls verification (defaults to false)
      insecure: true

    # optional: sasl support
    sasl:
      enabled: true
      username: xx
      password: xxx
      # optional configure sasl mechanism as plaintext, scram-sha256, scram-sha512 (defaults to plaintext)
      mechanism: plaintext

current-context: remote-cluster

(3.) 常用命令

# 切换配置
kafkactl config use-context dev
# 查看当前使用的配置
kafkactl config get-contexts
# 查看配置
 kafkactl config view
 
 # 创建主题
 kafkactl create topic my-topic --partitions=2
 # 获取主题
 kafkactl get topics
 # 查看主题详情
 kafkactl describe topic my-topic
 # 删除主题
 kafkactl delete topic my-topic
 
 # 生产数据
 echo "key##value1" | kafkactl produce my-topic --separator=##
 kafkactl produce my-topic --key=my-key --value=my-value
 # 消费数据
 kafkactl consume my-topic --from-beginning --print-keys -o yaml
 
 # 重置消费组
 kafkactl reset consumer-group-offset my-group --topic my-topic --oldest --execute
 # 获取消费组
 kafkactl get cg 
 # 查看具体的消费组
 kafkactl describe consumer-group my-group
 # 删除消费组
 kafkactl delete consumer-group my-group
 
 # 修改分区
 # set brokers 102,103 as replicas for partition 3 of topic my-topic
kafkactl alter topic my-topic 3 -r 102,103

# 获取broker
kafkactl get brokers
kafkactl describe broker 1

参考链接

https://github.com/deviceinsight/kafkactl

https://github.com/danielqsj/kafka_exporter

https://github.com/linkedin/Burrow