• kafka和zookeeper安装部署(版本弄不好就是坑)


    yum install -y unzip zip

    配置host

    vi /etc/host
    172.19
    .68.10 zk1

    1. zookeeper

    zookeeper下载地址

    http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz

    tar -zxvf apache-zookeeper-3.4.14.tar.gz

    mv apache-zookeeper-3.4.14 zookeeper

    cd /opt/zookeeper

    拷贝zoo_sample.cfg文件重命名为zoo.cfg,然后修改dataDir属性

    # 数据的存放目录
    dataDir=/opt/zkdata
    # 端口,默认就是2181
    clientPort=2181
    server.1=zk1:2888:3888

    配置环境变量

    # Zookeeper Environment Variable
    export ZOOKEEPER_HOME=/opt/zookeeper
    export PATH=$PATH:$ZOOKEEPER_HOME/bin

    在/opt/zookeeper/data文件下创建myid
      vi myid
      1

    Zookeeper 启动停止命令

    zkServer.sh start
    zkServer.sh stop

    2. kafka

    kafka下载地址

    http://kafka.apache.org/quickstart

    http://mirror.bit.edu.cn/apache/kafka/2.2.0/kafka_2.12-2.2.0.tgz

    tar -zxvf kafka_2.12-2.2.0.tgz

    修改config/server.properties

    #broker的全局唯一编号,不能重复
    
    broker.id=0
    
    #kafka消息存放的路径
    
    log.dirs=/opt/kafka/logs
    
    #broker需要使用zookeeper保存meta数据
    
    zookeeper.connect=localhost:2181

    https://blog.csdn.net/lizhitao/article/details/25667831 配置属性说明

    启动

    nohup bin/kafka-server-start.sh config/server.properties &

    3. 安装kafka-manager

    下载地址 https://github.com/yahoo/kafka-manager/releases

     sbt编译

    cd /etc/yum.repos.d/
    curl https://bintray.com/sbt/rpm/rpm > bintray-sbt-rpm.repo
    yum install sbt
    下载sbt
    wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.6/sbt-0.13.6.tgz
    tar -zxvf sbt-0.13.6.tgz
    添加环境变量
    vi /etc/profile

    export SBT_HOME=/opt/sb 
    export PATH=$PATH:/$SBT_HOME/bin
    /×修改sbt文件权限×/
    $ chmod u+x sbt 

    验证:检查sbt是否安装成功,查看命令输出

    修改镜像提高下载速度
    cd ~
    mkdir .sbt
    vim repositories

    [repositories]
    local
    aliyun: http://maven.aliyun.com/nexus/content/groups/public
    typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly

    sbt -version

    编译kafka-manager

    ./sbt clean dist

    出现此图表示更新成功

    cd  /opt/kafka-manager/target/universal/

    unzip kafka-manager-2.0.0.1.zip

    修改配置

    kafka-manager.zkhosts="localhost:2181"此行中的localhost,改为你的Zookeeper服务器的IP地址

    启动

    nohup ./kafka-manager -Dconfig.file=/opt/kafka-manager/target/universal/kafka-manager-2.0.0.1/conf/application.conf -Dhttp.port=9001 &

     win10上面运行连接远程kafka记得在C:WindowsSystem32driversetc下修改hosts

    47.103.*.* node1

  • 相关阅读:
    stat 命令家族(2)- 详解 pidstat
    stat 命令家族(1)- 详解 vmstat
    Linux常用命令
    Linux常用命令
    Linux常用命令
    Linux常用命令
    Linux常用命令
    Linux常用命令
    打通MySQL架构和业务的任督二脉
    PostgreSQL JOIN LATERAL
  • 原文地址:https://www.cnblogs.com/mutong1228/p/11066414.html
Copyright © 2020-2023  润新知