Updated on 2025-08-21 GMT+08:00

Viewing Kafka Metrics

Cloud Eye monitors Kafka instance metrics in real time. You can view each and key metrics on the Cloud Eye console.

Constraints

On the Monitoring > Monitoring Details page of the Kafka console, you can select a maximum of 50 resources from the drop-down list at a time. If you need to view the monitoring data of more than 50 resources, do so in batches.

Prerequisite

At least one Kafka instance has been created. The instance has at least one available message.

Procedure

  1. Log in to the Kafka console.
  2. Click in the upper left corner to select the region where your instance is located.
  3. View the instance metrics in either of the following ways:

    • View all monitoring data: In the row containing the desired instance, click View Metric. On the Cloud Eye console, view the metrics. Metric data is reported to Cloud Eye every minute.
    • View all monitoring data: Click the desired instance to go to the instance details page. In the navigation pane, choose Monitoring > Monitoring Details. On the displayed page, view the monitoring data. The data is updated every minute.
    • View monitoring data by topic: Click a Kafka instance name to go to the instance details page. In the navigation pane, choose Instance > Topics. Click the desired topic to go to the topic details page. On the monitoring page, view the monitoring data by topic. The data is updated every minute.
    • View monitoring data by consumer group: Click a Kafka instance name to go to the instance details page. In the navigation pane, choose Instance > Consumer Groups. Click the desired consumer group to go to the consumer group details page. On the monitoring page, view the monitoring data by consumer group. The data is updated every minute.

    Click the following dimensions to view monitoring data:

    • Single-node instance: By Instance, By Broker, By Topic, or By Consumer Group.
    • Cluster instance: By Instance, By Broker, By Topic, By Consumer Group, or By Smart Connect.

Viewing Top Kafka KPI Data

  1. Log in to the Kafka console.
  2. Click in the upper left corner to select the region where your instance is located.
  3. Click the desired instance to go to the instance details page.
  4. Choose Monitoring > Overview in the navigation pane.
  5. In the KPI Rankings area, check the top 5, top 10, and top 20 data by consumer group, topic, and broker.

    Table 1 KPI list

    Dimension

    Key Metric

    By Consumer Group

    • Accumulated Messages
    • Consumer Retrieved Messages

    By Topic

    • Total Messages
    • Message Creation
    • Message Retrieval

    Broker

    • CPU Usage
    • Network Bandwidth Usage
    • Disk Read Speed
    • Disk Write Speed
    Figure 1 KPI ranking

Checking the Monitoring View of Kafka Production Inbound Traffic

This function is unavailable for some existing instances. Contact customer service.

  1. Log in to the Kafka console.
  2. Click in the upper left corner to select the region where your instance is located.
  3. Click the desired instance to go to the instance details page.
  4. In the navigation pane, choose Monitoring > Overview.
  5. On KPI Rankings > By Dimension tab page, check the production inbound traffic.

    Table 2 Production inbound traffic

    Dimension

    Description

    By topic

    Topics are sorted by production inbound traffic in descending order, and the traffic is displayed by broker in different colors. Hovering your mouse over a topic bar displays the production inbound traffic of the broker.

    Select one or more brokers from the drop-down box in the upper right corner to view the broker production inbound traffic.

    A maximum of top 20 topics can be displayed.

    By broker

    Brokers are sorted by production inbound traffic in descending order, and the traffic is displayed by topic in different colors. Hovering your mouse over a broker bar displays the production inbound traffic of all topics.

    Select one or more topics from the drop-down box in the upper right corner to view the topic production inbound traffic.

    Figure 2 Production inbound traffic by broker