Checking the Consumption Status of Consumer Group

Scenario

This section describes how to view the current expenditure on the client based on service requirements.

Prerequisites

• MRS cluster administrator has understood service requirements and prepared a system user.

Procedure

1. Log in as a client installation user to the node on which the Kafka client is installed.
2. Switch to the Kafka client installation directory, for example, /opt/kafkaclient.

   cd /opt/kafkaclient

3. Run the following command to configure environment variables:

   source bigdata_env

4. Run the following command to perform user authentication (skip this step in normal mode):

   kinit Component service user

5. Run the following command to switch to the Kafka client installation directory:

   cd Kafka/kafka/bin

6. Run the kafka-consumer-groups.sh command to check the current consumption status.
   • Check the Consumer Group list on Kafka saved by Offset:

     ./kafka-consumer-groups.sh --list --bootstrap-server <Service IP address of any broker node:21007> --command-config ../config/consumer.properties

     eg:./kafka-consumer-groups.sh --bootstrap-server 192.168.1.1:21007 --list --command-config ../config/consumer.properties

   • Check the consumption status of Consumer Group on Kafka saved by Offset:

     ./kafka-consumer-groups.sh --describe --bootstrap-server <Service IP address of any broker node:21007> --group Consumer group name --command-config ../config/consumer.properties

     eg:./kafka-consumer-groups.sh --describe --bootstrap-server 192.168.1.1:21007 --group example-group --command-config ../config/consumer.properties

   

   1. Ensure that the current consumer is online and consumes data.
   2. Configure the group.id in the consumer.properties configuration file and --group in the command to the group to be queried.
   3. The Kafka cluster's IP port number is 21007 in security mode and 9092 in normal mode.