运维知识库
文档目录41 pages

Kafka-Eagle 监控

Kafka-Eagle 监控组件的 MySQL 依赖、Kafka JMX 配置、安装部署和页面访问。

Kafka-Eagle 监控

Kafka-Eagle框架可以监控Kafka集群的整体运行情况，在生产环境中经常使用。

1、MySQL环境准备

Kafka-Eagle的安装依赖于MySQL，MySQL主要用来存储可视化展示的数据。

如果集群中之前安装过MySQL可以跨过该步。

1.1docker安装mysql

安装docker
加载mysql镜像
启动mysql

1.2连接测试

2、Kafka环境准备

1）关闭Kafka集群

[root@kafka102 kafka-3.2.1]$ xkafka.sh stop

2）修改kafka-server-start.sh文件

修改/opt/module/kafka/bin/kafka-server-start.sh命令中

（1）原内容

[root@kafka102 kafka-3.2.1]$ vim bin/kafka-server-start.sh
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
    export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
fi

（2）修改后内容

[root@kafka102 kafka-3.2.1]$ vim bin/kafka-server-start.sh
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
    export KAFKA_HEAP_OPTS="-server -Xms2G -Xmx2G -XX:PermSize=128m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:ParallelGCThreads=8 -XX:ConcGCThreads=5 -XX:InitiatingHeapOccupancyPercent=70"
    export JMX_PORT="9999"
    #export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
fi

3）分发

[root@kafka102 kafka_2.11-0.11.0.2]$ xsync.sh bin/kafka-server-start.sh

4）kafka服务启动

[root@kafka102 kafka_2.11-0.11.0.2]$ kafka.sh start

3、Kafka Eagle（3.0.0）

3.1 安装部署

1）官网

https://www.kafka-eagle.org/

2）上传

[root@kafka102 software]$ rz

3）查看

[root@kafka102 software]$ ls -l | grep -i kafka
-rw-r--r-- 1 kafka kafka 104001442 Aug 23 15:17 kafka_2.12-3.2.1.tgz
-rw-r--r-- 1 kafka kafka  89962254 Aug 25 15:30 kafka-eagle-bin-3.0.0.tar.gz

4）解压

[root@kafka102 software]$ tar -xzvf kafka-eagle-bin-3.0.0.tar.gz
[root@kafka102 software]$ mv kafka-eagle-bin-3.0.0/efak-web-3.0.0-bin.tar.gz /opt/software/ [root@kafka102 software]$ tar -xzvf efak-web-3.0.0-bin.tar.gz -C /opt/module/

5）重命名

[root@kafka102 software]$ cd /opt/module/[root@kafka102 module]$ mv efak-web-3.0.0/ efak-3.0.0

6）查看

[root@kafka102 module]$ cd efak-3.0.0/
[root@kafka102 efak-3.0.0]$ ll
total 0
drwxrwxr-x 2 kafka kafka 52 Aug 25 15:51 bin
drwxrwxr-x 2 kafka kafka 75 Aug 25 15:51 conf
drwxr-xr-x 2 kafka kafka  6 Sep 13  2021 db
drwxrwxr-x 2 kafka kafka 23 Aug 25 15:51 font
drwxr-xr-x 9 kafka kafka 91 Feb 23  2022 kms
drwxr-xr-x 2 kafka kafka  6 Apr  2 01:26 logs

7）修改system-config.properties文件

[root@kafka102 efak-3.0.0]$ vim conf/system-config.properties
efak.zk.cluster.alias=cluster1
cluster1.zk.list=kafka102:2181,kafka103:2181,kafka104:2181/kafka
cluster1.efak.offset.storage=kafka
efak.driver=com.mysql.jdbc.Driver
efak.url=jdbc:mysql://kafka102:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull
efak.username=root
efak.password=kafka123

8）配置环境变量

[root@kafka102 efak-3.0.0]$ vim /etc/profile.d/env.sh
# kafkaEFAK
export KE_HOME=/opt/module/efak-3.0.0
export PATH=$PATH:$KE_HOME/bin

9）重新加载环境变量

[root@kafka102 efak-3.0.0]$ source /etc/profile

10）启动zookeeper

[root@kafka102 zookeeper-3.5.9]$ zk.sh start

11）启动kafka

[root@kafka102 kafka-3.2.1]$ xkafka.sh start

12）启动前查看MySQL服务

[root@kafka102 ~]$ systemctl status mysqld

13）启动 kafka Eagle

[root@kafka102 efak-3.0.0]$ bin/ke.sh start
[root@kafka102 efak-3.0.0]#  bin/ke.sh start

[2026-02-22 05:03:17] INFO: Starting  EFAK( Eagle For Apache Kafka ) environment check ...
  已创建: META-INF/
  已解压: META-INF/MANIFEST.MF
  已创建: WEB-INF/
  已创建: WEB-INF/classes/
  已创建: WEB-INF/classes/messages/
  已创建: WEB-INF/classes/org/
  已创建: WEB-INF/classes/org/smartloli/
  已创建: WEB-INF/classes/org/smartloli/kafka/
  已创建: WEB-INF/classes/org/smartloli/kafka/eagle/
  已创建: WEB-INF/classes/org/smartloli/kafka/eagle/web/
  已创建: WEB-INF/classes/org/smartloli/kafka/eagle/web/dao/
  已创建: WEB-INF/classes/org/smartloli/kafka/eagle/web/mapper/

Welcome to
    ______    ______    ___     __ __
   / ____/   / ____/   /   |   / //_/
  / __/     / /_      / /| |  / ,<
 / /___    / __/     / ___ | / /| |
/_____/   /_/       /_/  |_|/_/ |_|
( Eagle For Apache Kafka® )

Version 2.0.8 -- Copyright 2016-2021
*******************************************************************
* EFAK Service has started success.
* Welcome, Now you can visit 'http://192.168.2.102:8048'
* Account:admin ,Password:123456
*******************************************************************
* <Usage> ke.sh [start|status|stop|restart|stats] </Usage>
* <Usage> https://www.kafka-eagle.org/ </Usage>
*******************************************************************

14）查看kafka Eagle 进程

[root@kafka102 efak-3.0.0]# jps
45718 Kafka
49943 KafkaEagle
68520 Jps
44351 QuorumPeerMain
[root@kafka102 efak-3.0.0]#

15）关闭 kafka Eagle

[root@kafka102 efak-3.0.0]$ bin/ke.sh stop

3.2 Kafka-Eagle 页面操作

1）登录页面查看监控数据

http://192.168.10.102:8048/

username: admin

password: 123456

2）首页