Viewing Kafka Consumer Information

Note on Viewing the Consumer Address on Kafka Manager

Due to cache reasons, the consumer connection addresses displayed on Kafka Manager may have expired. In this case, restart Kafka Manager.

Prerequisites

The consumer list and connection address can be viewed only when consumers in a consumer group are connected to the Kafka instance (that is, the consumer group is in the STABLE state).

Viewing the Consumer List (Console)

1. Log in to the console.
2. Click in the upper left corner to select a region.
   

   Select the region where your Kafka instance is located.

3. Click and choose Application > Distributed Message Service (for Kafka) to open the console of DMS for Kafka.
4. Click a Kafka instance name to go to the instance details page.
5. In the navigation pane, choose Consumer Groups.
6. Click the name of the desired consumer group.
7. On the Consumers tab page, view the consumer list.

   In the consumer list, you can view the consumer ID, consumer address, and client ID.

8. (Optional) To query a specific consumer, enter the consumer ID in the search box and press Enter.

Viewing the Consumer List (Kafka CLI)

• For a Kafka instance with SASL disabled, run the following command in the /bin directory of the Kafka client:

  ./kafka-consumer-groups.sh --bootstrap-server ${connection-address} --group ${group-name} --members --describe

  Parameter description:

  • connection-address: can be obtained from the Connection area on the Basic Information page on the Kafka console.
  • group-name: consumer group name.

  Example:

  [root@ecs-kafka bin]# ./kafka-consumer-groups.sh --bootstrap-server 192.168.xx.xx:9092,192.168.xx.xx:9092,192.168.xx.xx:9092 --group test --members --describe
  
  GROUP           CONSUMER-ID                                           HOST            CLIENT-ID        #PARTITIONS     
  test            console-consumer-571a64fe-b0c4-47ce-833d-9e0da5a88d14 /192.168.0.215  console-consumer 3               
  [root@ecs-kafka bin]#

• For a Kafka instance with SASL enabled, do as follows:
  1. (Optional) If the username and password, and the SSL certificate has been configured, skip this step and go to 2. Otherwise, do as follows:

     Create the ssl-user-config.properties file in the /config directory of the Kafka client. Add the username and password, and the SSL certificate configuration by referring to 3.

  2. Run the following command in the /bin directory of the Kafka client:

     ./kafka-consumer-groups.sh --bootstrap-server ${connection-address} --group ${group-name} --members --describe --command-config ../config/ssl-user-config.properties 

     Parameter description:

     • connection-address: can be obtained from the Connection area on the Basic Information page on the Kafka console.
     • group-name: consumer group name.

     Example:

     [root@ecs-kafka bin]# ./kafka-consumer-groups.sh --bootstrap-server 192.168.xx.xx:9093,192.168.xx.xx:9093,192.168.xx.xx:9093 --group test --members --describe --command-config ../config/ssl-user-config.properties
     
     GROUP           CONSUMER-ID                                           HOST            CLIENT-ID        #PARTITIONS     
     test            console-consumer-566d0c82-07d3-4d87-9a6e-f57a9bc9fc69 /192.168.0.215  console-consumer 3               
     [root@ecs-kafka bin]#

Viewing Consumer Connection Addresses (Console)

1. Log in to the console.
2. Click in the upper left corner to select a region.
   

   Select the region where your Kafka instance is located.

3. Click and choose Application > Distributed Message Service (for Kafka) to open the console of DMS for Kafka.
4. Click the desired Kafka instance to view the instance details.
5. In the navigation pane, choose Consumer Groups.
6. Click the desired consumer group.
7. On the Consumers tab page, view the consumer addresses.

Viewing Consumer Connection Addresses (Kafka Manager)

1. Log in to Kafka Manager.
2. Click kafka_cluster to go to the cluster details page.
3. On the top menu bar, choose Consumers.
   Figure 1 Navigation bar
   

4. Click the desired consumer group to view the topics that the group has subscribed to.
   Figure 2 Consumer group list
   

5. Click the desired topic to go to the topic details page.
   Figure 3 Topics that the consumer group has subscribed to
   

6. In the Consumer Instance Owner column, view the consumer connection address.
   Figure 4 Topic details page