Kafdrop-Kafka开源可视化工具 - 文章 - 开发者社区

Kafdrop是Apache Kafka的开源Web UI可视化工具。

主要功能

查看Kafka代理 -主题和分区分配以及控制器状态
查看主题 -分区数，复制状态和自定义配置
浏览消息 -JSON，纯文本和Avro编码
查看消费者组 -每个分区的停放偏移量，合并延迟和每个分区滞后
创建新主题
查看ACL

1、编排文件


          
[administrator@JavaLangOutOfMemory luga]% vi docker-compose-kafdrop.yml
          
version: "2"
          
services:
          
kafdrop:
          
image: obsidiandynamics/kafdrop
          
restart: "no"
          
ports:
          
- "9000:9000"
          
environment:
          
KAFKA_BROKERCONNECT: "kafka:29092"
          
JVM_OPTS: "-Xms16M -Xmx48M -Xss180K -XX:-TieredCompilation -XX:+UseStringDeduplication -noverify"
          
depends_on:
          
- "kafka"
          
kafka:
          
image: obsidiandynamics/kafka
          
restart: "no"
          
ports:
          
- "2181:2181"
          
- "9092:9092"
          
environment:
          
KAFKA_LISTENERS: "INTERNAL://:29092,EXTERNAL://:9092"
          
KAFKA_ADVERTISED_LISTENERS: "INTERNAL://kafka:29092,EXTERNAL://localhost:9092"
          
KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: "INTERNAL:PLAINTEXT,EXTERNAL:PLAINTEXT"
          
KAFKA_INTER_BROKER_LISTENER_NAME: "INTERNAL"
          
KAFKA_ZOOKEEPER_SESSION_TIMEOUT: "6000"
          
KAFKA_RESTART_ATTEMPTS: "10"
          
KAFKA_RESTART_DELAY: "5"
          
ZOOKEEPER_AUTOPURGE_PURGE_INTERVAL: "0"

2、启动服务


        
            

          [administrator@JavaLangOutOfMemory luga]% docker-compose -f docker-compose-kafdrop.yaml up -d

3、访问web页面 http://ip:9000

picture.image

4、模拟生产者生产消息


          
bash-4.4# ./kafka-console-producer.sh --broker-list localhost:9092 --topic FLINK_TO_TASK_PROD
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020202'
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020203'
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020205'
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020208'
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020200'
          
>'Merchant-2020-001' Values:'111111111111100000000000000','MerID:20200202020207'
          
>

5、查看及检索消息

picture.image