Kafka Cluster Monitoring Management

Updated on 2024-07-19 GMT+08:00

View PDF

The Kafka cluster monitoring management includes the following operations:

Viewing Broker Information
Viewing Topic Information
Viewing Consumers Information
Modifying the Partition of a Topic Through KafkaManager

Viewing Broker Information

Log in to the KafkaManager web UI.
On the cluster list page, click a cluster name to access the Summary page of the cluster.

Figure 1 Summary page of a cluster
Click Brokers to access the Broker monitoring page. The page displays the Broker list and I/O statistics of the Broker nodes.

Figure 2 Broker monitoring page

Viewing Topic Information

Log in to the KafkaManager web UI.
On the cluster list page, click a cluster name to access the Summary page of the cluster.
Choose Topic > List to view the topic list of the current cluster and information about each topic.

Figure 3 Topic list
Click a topic name to view details about the topic.

Figure 4 Topic details

Viewing Consumers Information

Log in to the KafkaManager web UI.
On the cluster list page, click a cluster name to access the Summary page of the cluster.
Click Consumers to view the consumers of the current cluster and each consumer's consumption information.

Figure 5 Consumers
Click a consumer name to view the list of the consumed topics.

Figure 6 List of topics consumed by the consumer
Click a topic name in the topic list of the consumer to view consumption information about the topic.

Figure 7 Topic consumption details

Modifying the Partition of a Topic Through KafkaManager

Log in to the KafkaManager web UI.
On the cluster list page, click a cluster name to access the Summary page of the cluster.
Choose Topic > List to access the topic list page of the current cluster.
Click a topic name to access the Topic Summary page.
Click Add Partitions. The page for adding partitions is displayed.

Figure 8 Adding partitions
Confirm the topic name and modify the value of the Partitions parameter and click Add Partitions to add partitions.

Figure 9 Modifying the number of partitions
After the partitions are added successfully, click Go to topic view to return to the Topic Summary page.
Check the number of partitions in Partition Information in the lower part of the Topic Summary page.

Figure 10 Partition Information
(Optional) If you are not satisfied with the assigned partitions, you can use the partition reassignment function to automatically reassign partitions.
1. On the Topic Summary page, click Generate Partition Assignments.
2. Select the broker instance and click Generate Partition Assignments to generate a partition.
3. After partition generation, click Go to topic view to return to the Topic Summary page.
4. On the Topic Summary page, click Reassign Partitions to automatically assign partitions to the broker instance of the cluster.
5. Click Go to reassign partitions to view details about the reassigned partitions.
(Optional) If you are not satisfied with the automatically assigned partitions, you can manually assign the partitions.
1. On the Topic Summary page, click Manual Partition Assignments to access the page for manually assign partitions.
2. Manually assign a broker ID to each partition replica, and click Save Partition Assignment to save the changes.
3. Click Go to topic view to return to the Topic Summary page and view the partition details.

Parent topic: Using KafkaManager

Previous topic: Managing Kafka Clusters

Next topic: Using Loader

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot