Skip to content

Instantly share code, notes, and snippets.

@dobeerman
Forked from dkurzaj/README.md
Created October 9, 2022 09:48
Show Gist options
  • Save dobeerman/7ba3c9814a8fb14431d4a547dfe7fac4 to your computer and use it in GitHub Desktop.
Save dobeerman/7ba3c9814a8fb14431d4a547dfe7fac4 to your computer and use it in GitHub Desktop.
Docker compose Kafka, Zookeeper and Kafka manager

How to use

Install

  • Create the network :
$ docker network create --driver bridge kafka-net
  • Create the folders :
$ mkdir -p {zookeeper,kafka}/{data,logs}

Run

  • Execute the docker compose :
$ docker-compose -f docker-compose.yml up -d
  • Access Kafka Manager : http://localhost:9000/.

  • Create a new cluster.

  • Name it as you like (Localtest for example).

  • IP : zookeeper:2181

  • Kafka version (corresponding here to the Kafka version inside the image : ches/kafka:0.10.2.1) : 0.10.2.1

And then create it.

This is done !

To stop the containers and remove them, run :

$ docker-compose -f docker-compose.yml stop && docker-compose -f docker-compose.yml rm -vf
version: '3.1'
networks:
default:
external:
name: kafka-net
services:
zookeeper:
container_name: zookeeper
image: zookeeper:3.4
restart: on-failure
volumes:
- "./zookeeper/data:/data"
- "./zookeeper/logs:/datalog"
ports:
- "2181:2181"
kafka:
container_name: kafka
image: ches/kafka:0.10.2.1
restart: on-failure
depends_on:
- zookeeper
links:
- zookeeper
volumes:
- "./kafka/data:/data"
- "./kafka/logs:/logs"
environment:
- ZOOKEEPER_IP=zookeeper
- JMX_PORT=9994
- KAFKA_LOG_RETENTION_HOURS=168
- KAFKA_AUTO_CREATE_TOPICS_ENABLE=true
ports:
- "9092:9092"
kafka-manager:
container_name: kafka-manager
image: hlebalbau/kafka-manager:1.3.3.16
restart: on-failure
depends_on:
- kafka
- zookeeper
links:
- kafka
- zookeeper
command: -Dconfig.file=/kafka-manager/conf/application.conf -Dkafka-manager.zkhosts="zookeeper:2181"
environment:
- ZK_HOSTS=zookeeper:2181
- APPLICATION_SECRET=letmein
ports:
- "9000:9000"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment