Viewing Kafka Topic Information

Scenario

You can view information about created Kafka topics on the Manager or Kafka UI.

Viewing Kafka Topic Information on the Manager

1. Go to the Kafka service page.
   • For versions earlier than MRS 3.x, click the cluster name to go to the cluster details page and choose Components > Kafka.
     

     If the Components tab is unavailable, complete IAM user synchronization first. (On the Dashboard page, click Synchronize on the right side of IAM User Sync to synchronize IAM users.)

   • For MRS 3.x or later, log in to FusionInsight Manager. For details, see Accessing FusionInsight Manager (MRS 3.x or Later). Choose Cluster > Name of the desired cluster > Services > Kafka.

2. Click KafkaTopicMonitor.

   All topics are displayed in the list by default. You can view the number of partitions and replicas of the topics.

3. Click the desired topic in the list to view its details.
   

   If the following operations are performed, Kafka topic monitoring may not be displayed:

   • Capacity expansion or reduction has been performed on Kafka or ZooKeeper.
   • Instances have been added to or deleted from Kafka or ZooKeeper.
   • The Elasticsearch service is reinstalled.
   • Kafka is switched to another ZooKeeper service.

   Perform the following steps to rectify the fault:

   1. Log in to the active OMS node of the cluster and run the following command to switch to user omm:

      su - omm

   2. Restart the CEP service.

      restart_app cep

      Wait for 3 minutes and check the Kafka topic monitoring again.

Viewing Kafka Topic Information on the Kafka UI (for MRS 3.1.2 and Later)

1. Access the Kafka UI.
   1. Log in to FusionInsight Manager as a user who has the permission to access the Kafka UI and choose Cluster > Services > Kafka.

      If you need to perform operations on the page, for example, creating a topic, you need to grant related permissions to users. For details, see Kafka User Permissions.

   2. On the right of KafkaManager WebUI, click the URL to access the Kafka UI.

2. Click Brokers.
3. In the Broker Summary area, you can view Broker ID, Host, Rack, Disk(Used|Total), and Memory(Used|Total) of brokers.

   

4. View the JMX metrics for broker node data traffic in the Brokers Metrics area. You can check the average number of incoming messages per second, incoming and outgoing message byte counts per second, failed requests per second, total requests per second, and production requests per second in various time windows.

   

5. Enter a host IP address or rack configuration information in the upper right corner of the page to search for a broker.