1.介绍
rocketmq由consumer,producer,broker三大块组成,如何对这三类服务进行运维操作呢?这里介绍rocketmq自带的命令行工具:mqadmin
2.位置
项目:https://github.com/apache/rocketmq.git
${PWD}/rocketmq/distribution/bin/mqadmin
3.脚本
3.1 mqadmin
#这里ROCKETMQ_HOME对应的是rocketmq的主目录
if [ -z "$ROCKETMQ_HOME" ] ; then ## resolve links - $0 may be a link to maven's home PRG="$0" # need this for relative symlinks while [ -h "$PRG" ] ; do ls=`ls -ld "$PRG"` link=`expr "$ls" : '.*-> (.*)$'` if expr "$link" : '/.*' > /dev/null; then PRG="$link" else PRG="`dirname "$PRG"`/$link" fi done saveddir=`pwd` ROCKETMQ_HOME=`dirname "$PRG"`/.. # make it fully qualified ROCKETMQ_HOME=`cd "$ROCKETMQ_HOME" && pwd` cd "$saveddir" fi export ROCKETMQ_HOME #这里实际使用的另外一个脚本tools.sh sh ${ROCKETMQ_HOME}/bin/tools.sh org.apache.rocketmq.tools.command.MQAdminStartup $@
3.2 tools.sh
主要作用就是设置JVM参数,然后使用java 启动对应classs
#=========================================================================================== # Java Environment Setting #=========================================================================================== error_exit () { echo "ERROR: $1 !!" exit 1 } [ ! -e "$JAVA_HOME/bin/java" ] && JAVA_HOME=$HOME/jdk/java [ ! -e "$JAVA_HOME/bin/java" ] && JAVA_HOME=/usr/java [ ! -e "$JAVA_HOME/bin/java" ] && error_exit "Please set the JAVA_HOME variable in your environment, We need java(x64)!" export JAVA_HOME export JAVA="$JAVA_HOME/bin/java" export BASE_DIR=$(dirname $0)/.. export CLASSPATH=.:${BASE_DIR}/conf:${CLASSPATH} #=========================================================================================== # JVM Configuration #=========================================================================================== JAVA_OPT="${JAVA_OPT} -server -Xms1g -Xmx1g -Xmn256m -XX:PermSize=128m -XX:MaxPermSize=128m" JAVA_OPT="${JAVA_OPT} -Djava.ext.dirs=${BASE_DIR}/lib:${JAVA_HOME}/jre/lib/ext" JAVA_OPT="${JAVA_OPT} -cp ${CLASSPATH}"
#这里是实际调用 $JAVA ${JAVA_OPT} $@
3.3 MQAdminStartup.java
MQAdminStartup.java是个入口类,里面注册了如下的各类命令,如需详细了解细节可以直接进入${PWD}/rocketmq/tools/src/main/java/org/apache/rocketmq/tools/command目录下查看:
import org.apache.rocketmq.tools.command.broker.BrokerConsumeStatsSubCommad; import org.apache.rocketmq.tools.command.broker.BrokerStatusSubCommand; import org.apache.rocketmq.tools.command.broker.CleanExpiredCQSubCommand; import org.apache.rocketmq.tools.command.broker.CleanUnusedTopicCommand; import org.apache.rocketmq.tools.command.broker.GetBrokerConfigCommand; import org.apache.rocketmq.tools.command.broker.SendMsgStatusCommand; import org.apache.rocketmq.tools.command.broker.UpdateBrokerConfigSubCommand; import org.apache.rocketmq.tools.command.cluster.CLusterSendMsgRTCommand; import org.apache.rocketmq.tools.command.cluster.ClusterListSubCommand; import org.apache.rocketmq.tools.command.connection.ConsumerConnectionSubCommand; import org.apache.rocketmq.tools.command.connection.ProducerConnectionSubCommand; import org.apache.rocketmq.tools.command.consumer.ConsumerProgressSubCommand; import org.apache.rocketmq.tools.command.consumer.ConsumerStatusSubCommand; import org.apache.rocketmq.tools.command.consumer.DeleteSubscriptionGroupCommand; import org.apache.rocketmq.tools.command.consumer.StartMonitoringSubCommand; import org.apache.rocketmq.tools.command.consumer.UpdateSubGroupSubCommand; import org.apache.rocketmq.tools.command.message.CheckMsgSendRTCommand; import org.apache.rocketmq.tools.command.message.ConsumeMessageCommand; import org.apache.rocketmq.tools.command.message.PrintMessageByQueueCommand; import org.apache.rocketmq.tools.command.message.PrintMessageSubCommand; import org.apache.rocketmq.tools.command.message.QueryMsgByIdSubCommand; import org.apache.rocketmq.tools.command.message.QueryMsgByKeySubCommand; import org.apache.rocketmq.tools.command.message.QueryMsgByOffsetSubCommand; import org.apache.rocketmq.tools.command.message.QueryMsgByUniqueKeySubCommand; import org.apache.rocketmq.tools.command.message.SendMessageCommand; import org.apache.rocketmq.tools.command.namesrv.DeleteKvConfigCommand; import org.apache.rocketmq.tools.command.namesrv.GetNamesrvConfigCommand; import org.apache.rocketmq.tools.command.namesrv.UpdateKvConfigCommand; import org.apache.rocketmq.tools.command.namesrv.UpdateNamesrvConfigCommand; import org.apache.rocketmq.tools.command.namesrv.WipeWritePermSubCommand; import org.apache.rocketmq.tools.command.offset.CloneGroupOffsetCommand; import org.apache.rocketmq.tools.command.offset.ResetOffsetByTimeCommand; import org.apache.rocketmq.tools.command.queue.QueryConsumeQueueCommand; import org.apache.rocketmq.tools.command.stats.StatsAllSubCommand; import org.apache.rocketmq.tools.command.topic.AllocateMQSubCommand; import org.apache.rocketmq.tools.command.topic.DeleteTopicSubCommand; import org.apache.rocketmq.tools.command.topic.TopicClusterSubCommand; import org.apache.rocketmq.tools.command.topic.TopicListSubCommand; import org.apache.rocketmq.tools.command.topic.TopicRouteSubCommand; import org.apache.rocketmq.tools.command.topic.TopicStatusSubCommand; import org.apache.rocketmq.tools.command.topic.UpdateOrderConfCommand; import org.apache.rocketmq.tools.command.topic.UpdateTopicPermSubCommand; import org.apache.rocketmq.tools.command.topic.UpdateTopicSubCommand;
3.4 命令详解
整体来说,命令分为如下几大类:
1. 集群相关:
- clusterList:查看集群列表
- clusterRT:测试集群的响应耗时
2. broker相关
- updateBrokerConfig :更新broker的配置
- brokerStatus :获取broker的运行时状态数据
- wipeWritePerm:设置某broker为只读
- getBrokerConfig:获取broker的配置信息
3.topic相关:
- updateTopic:创建或更新topic
- deleteTopic :从nameserver和broker中删除topic信息
- updateTopic:更新topic的perm信息
- topicRoute:获取topic的路由信息
- topicStatus: 获取topic的当前状态信息
- topicClusterList:获取topic对应的集群信息
- topicList:查看集群中的topic列表
- statsAll: 查看所有topic已经对应的consumer的消费进度
- cleanUnusedTopic:清理集群中无用的topic
4.message相关:
- queryMsgById: 通过message的id查询消息
- queryMsgByKey:通过message的key查询消息
- queryMsgByUniqueKey:通过message的UniqueKey查询消息
- queryMsgByOffset:通过偏移查询message 、
- printMsg:打印某条message的详情
- printMsgByQueue:打印某个queue(队列)里的消息的详情
- sendMsgStatus:向broker发送消息
- sendMessage:发送一条消息
- producerConnection:查询producer的信息(socket连接,客户端版本)
5. 消费相关:
- consumerConnection :查询consumer的信息(socker连接,客户端版本,消费组)
- consumerProgress :查询consumer的消费进度,tps
- consumerStatus :查询consumer的的内部数
- brokerConsumeStats:查看所有topic对应的消费数据(broker的offset,consumer的offset,是否有diff)
- cleanExpiredCQ:清理集群中无用的消费组cloneGroupOffset clone offset from other group.
- cloneGroupOffset :克隆指定topic下某个消费组的消费进度到指定消费组
- resetOffsetByTime:设置consumer的offset到某个时间点
- checkMsgSendRT:测试消费发生的响应耗时
- consumeMessage:消费消息
- queryCq:查询consumer指定队列和索引位置的消费信息
- updateSubGroup:创建或者更新消费组(订阅组)
- deleteSubGroup:从broker中删除消费组(订阅组)
6. nameserver相关:
- updateKvConfig:更新nameserver的kv配置
- deleteKvConfig:删除nameserver的kv配置
- getNamesrvConfig:获取nameserver的配置
- updateNamesrvConfig:更新nameserver的配置
7. acl相关:
- updateAclConfig:更新acl配置
- deleteAccessConfig:删除acl配置的账户
- clusterAclConfigVersion:查看集群的acl配置版本
- updateGlobalWhiteAddr:更新acl里面的白名单
- getAccessConfigSubCommand:查看acl的配置信息
8. 其他:
- updateOrderConf Create or update or delete order conf
- startMonitoring Start Monitoring
- allocateMQ Allocate MQ
博主:测试生财(一个不为996而996的测开码农)
座右铭:专注测试开发与自动化运维,努力读书思考写作,为内卷的人生奠定财务自由。
内容范畴:技术提升,职场杂谈,事业发展,阅读写作,投资理财,健康人生。
csdn:https://blog.csdn.net/ccgshigao
博客园:https://www.cnblogs.com/qa-freeroad/
51cto:https://blog.51cto.com/14900374
微信公众号:测试生财(定期分享独家内容和资源)