• Docker搭建kafka

    一、拉取镜像

    docker pull wurstmeister/zookeeper
docker pull wurstmeister/kafka

    二、检查 docker-compose

    docker-compose -v

    三、创建 docker-compose.yml 文件

    cd /data && mkdir docker-compose && cd docker-compose

touch docker-compose.yml

    添加内容

    version: '1'
services:
  zookeeper:
    image: "zookeeper"
    hostname: "zookeeper"
    container_name: "zookeeper"
  kafka:
    image: "wurstmeister/kafka"
    hostname: "kafka"
    container_name: "kafka"
    ports:
      - "9092:9092"
    environment:
      KAFKA_ADVERTISED_HOST_NAME: kafka
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
#设置网络，名为local
networks:
  local:
    driver: bridge

    四、进入该文件所在目录执行

    cd /data/docker-compose
docker-compose build

    五、启动服务

    docker-compose up -d

    六、查看容器

    docker ps

    七、进入容器之中

    docker exec -it kafka bash

    八、创建topic

    kafka-topics.sh --create --zookeeper zookeeper:2181 -replication-factor 1 --partitions 1 --topic mykafka

    执行后输出 Created topic mykafka. 表示成功

    九、查看topic

    kafka-topics.sh --list --zookeeper zookeeper:2181

    十、创建生产者

    kafka-console-producer.sh --broker-list kafka:9092 --topic mykafka

    十一、查看topic内容

    kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic mykafka --from-beginning

      

    转载自：

    https://www.jianshu.com/p/16e4fb821fa8

    备注：

    经常抛出 host kafka not found的问题，我的做法是更改 /etc/hosts 的域名配置文件，增加一行

    127.0.0.1 kafka

    我的验证的 java 脚本：

    package com.example.one.kafka;
import java.util.Properties;
import org.apache.kafka.clients.producer.Producer;
import org.apache.kafka.clients.producer.KafkaProducer;
import org.apache.kafka.clients.producer.ProducerRecord;
import org.apache.kafka.common.serialization.StringSerializer;

// 示例地址: https://www.yiibai.com/kafka/apache_kafka_simple_producer_example.html
public class SimpleProducer {
    public static void main(String[] args) throws Exception {
        //Assign topicName to string variable
        String topicName = "mykafka";
        // create instance for properties to access producer configs
        Properties props = new Properties();
        //Assign localhost id
        props.put("bootstrap.servers", "localhost:9092");
        //Set acknowledgements for producer requests.
        props.put("acks", "all");
        //If the request fails, the producer can automatically retry,
        props.put("retries", 0);
        //Specify buffer size in config
        props.put("batch.size", 16384);
        //Reduce the no of requests less than 0
        props.put("linger.ms", 1);
        //The buffer.memory controls the total amount of memory available to the producer for buffering.
        props.put("buffer.memory", 33554432);
        props.put("key.serializer","org.apache.kafka.common.serialization.StringSerializer");
        props.put("value.serializer","org.apache.kafka.common.serialization.StringSerializer");

        Producer<String, String> producer = new KafkaProducer
                <String, String>(props);

        for (int i = 8; i < 19; i++)
            producer.send(new ProducerRecord<String, String>(topicName,
                    Integer.toString(i), Integer.toString(i)));
        System.out.println("Message sent successfully");
        producer.close();
    }
}

     docker下载地址

    https://download.docker.com/
  • 相关阅读:
    关于docker日常操作（一）
    html基础
    Java6开发WebService进阶
    Java6开发WebService入门
    jsp session
    jsp中的request
    java文件上传下载
    javaweb文件上传下载
    struts2文件上传下载
    springMVC文件上传下载
  • 原文地址：https://www.cnblogs.com/xuweiqiang/p/16217546.html
Copyright © 2020-2023  润新知