On this page

Show all

Help Center/ MapReduce Service/ User Guide (Ankara Region)/ Troubleshooting/ Using Kafka/ Consumer Fails to Consume Data in a Newly Created Cluster, and the Message " GROUP_COORDINATOR_NOT_AVAILABLE" Is Displayed

Consumer Fails to Consume Data in a Newly Created Cluster, and the Message " GROUP_COORDINATOR_NOT_AVAILABLE" Is Displayed

Updated on 2024-11-29 GMT+08:00

View PDF

Symptom

A Kafka cluster is created, and two Broker nodes are deployed. The Kafka client can be used for production but cannot be used for consumption. The Consumer fails to consume data, and the message "GROUP_COORDINATOR_NOT_AVAILABLE" is displayed. The key log is as follows:

2018-05-12 10:58:42,561 | INFO | [kafka-request-handler-3] | [GroupCoordinator 2]: Preparing to restabilize group DemoConsumer with old generation 118 | kafka.coordinator.GroupCoordinator (Logging.scala:68)
2018-05-12 10:59:13,562 | INFO | [executor-Heartbeat] | [GroupCoordinator 2]: Preparing to restabilize group DemoConsumer with old generation 119 | kafka.coordinator.GroupCoordinator (Logging.scala:68)

Possible Causes

The __consumer_offsets cannot be created.

Cause Analysis

As indicated by the log, a large number of _consumer_offset creation operations failed.
The number of Brokers for the cluster is 2.

However, the number of replicas for the _consumer_offset topic is 3. Therefore, the creation fails.

Solution

Expand the cluster to at least three streaming core nodes or perform the following steps to modify service configuration parameters:

Go to the service configuration page.
- MRS Manager: Log in to MRS Manager, choose Services > Kafka > Service Configuration, and select All from Type.
- FusionInsight Manager: Log in to FusionInsight Manager. Choose Cluster > Services > Kafka. Click Configurations and select All Configurations.
Search for offsets.topic.replication.factor and transaction.state.log.replication.factor and change their values to 2.
Click Save Configuration and select Restart the affected services or instances. Click OK to restart the services.

Parent topic: Using Kafka

Previous topic: Consumer Fails to Consume Data and Remains in the Waiting State

Next topic: SparkStreaming Fails to Consume Kafka Messages, and the Message "Couldn't find leader offsets" Is Displayed

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot