Help Center/ MapReduce Service/ Component Operation Guide (Normal)/ Using KafkaManager/ Managing Kafka Clusters
Updated on 2022-09-15 GMT+08:00
View PDF

Managing Kafka Clusters

Kafka cluster management includes the following operations:

Adding a Cluster on the KafkaManager Web UI

After a Kafka cluster is created for the first time, a default Kafka cluster named my-cluster is created on the KafkaManager web UI. You can also add Kafka clusters that have been created on the MRS management console on the KafkaManager web UI to manage multiple Kafka clusters.

  1. Log in to the KafkaManager web UI.
  2. In the upper part of the page, choose Cluster > Add Cluster.

    Figure 1 Adding a cluster

  3. Set the cluster parameters. For the following parameters, refer to their example values. Retain the default values for other parameters.

    Table 1 Cluster parameters to be modified

    Parameter

    Example Value

    Description

    Cluster Name

    mrs-demo

    Name of the cluster to be added on the KafkaManager web UI

    Cluster Zookeeper Hosts

    zk1_ip:zk1_port, zk2_ip:zk2_port/kafka

    ZooKeeper address of the cluster to be added

    Kafka Version

    1.1.0

    Kafka version of the cluster to be added. The default value is 1.1.0.

    Enable JMX Polling (Set JMX_PORT env variable before starting kafka server)

    Selected

    -

    Poll consumer information (Not recommended for large # of consumers)

    Selected

    -

    Enable Active OffsetCache (Not recommended for large # of consumers)

    Selected

    -

    Display Broker and Topic Size (only works after applying this patch)

    Selected

    -

    Security Protocol

    PLAINTEXT
    • For a Kafka cluster with Kerberos authentication enabled, select SASL_PLAINTEXT.
    • For a Kafka cluster with Kerberos authentication disabled, select PLAINTEXT.

  4. Click Save.

Updating Cluster Parameters

  1. Log in to the KafkaManager web UI.
  2. Click Modify in the Operations column of the cluster.

    Figure 2 Updating cluster parameters

  3. Go to the cluster configuration page and modify cluster parameters.

Deleting a Cluster on the KafkaManager Web UI

  1. Log in to the KafkaManager web UI.
  2. Click Disable in the Operations column of the cluster.

    Figure 3 Disabling a cluster

  3. When Delete or Enable is displayed in the Operations column on the cluster list page, click Delete to delete the cluster. You can also click Enable to enable the cluster.

    Figure 4 Enabling or deleting a cluster

Parent topic: Using KafkaManager