Checking the Consumption Status of Consumer Group

Scenario

This section describes how to view the current expenditure on the client based on service requirements.

This section applies to MRS 3.x or later.

Prerequisites

• You have understood service requirements and prepared a system user.

Procedure

1. Log in as a client installation user to the node on which the Kafka client is installed.
2. Switch to the Kafka client installation directory, for example, /opt/kafkaclient.

   cd /opt/kafkaclient

3. Run the following command to configure environment variables:

   source bigdata_env

4. Run the following command to perform user authentication (skip this step in normal mode):

   kinit Component service user

5. Run the following command to switch to the Kafka client installation directory:

   cd Kafka/kafka/bin

6. Run the kafka-consumer-groups.sh command to check the current consumption status.
   • Check the Consumer Group list on Kafka saved by Offset:

     ./kafka-consumer-groups.sh --list --bootstrap-server <Service IP address of any broker node:21007> --command-config ../config/consumer.properties

     eg:./kafka-consumer-groups.sh --bootstrap-server 192.168.1.1:21007 --list --command-config ../config/consumer.properties

   • Check the consumption status of Consumer Group on Kafka saved by Offset:

     ./kafka-consumer-groups.sh --describe --bootstrap-server <Service IP address of any broker node:21007> --group Consumer group name --command-config ../config/consumer.properties

     eg:./kafka-consumer-groups.sh --describe --bootstrap-server 192.168.1.1:21007 --group example-group --command-config ../config/consumer.properties

   

   1. Ensure that the current consumer is online and consumes data.
   2. Configure the group.id in the consumer.properties configuration file and --group in the command to the group to be queried.
   3. The Kafka cluster's IP port number is 21007 in security mode and 9092 in normal mode.