What Can I Do If Kafka Messages Are Accumulated?

Symptom: An alarm is generated for the Accumulated Messages metric.

Solution 1:

1. Log in to the Kafka console and click the instance for which the alarm is generated. The instance details page is displayed.
2. Choose Monitoring and Alarms > Monitoring Details in the navigation pane.
3. On the By Consumer Group tab page, view Consumer Retrieved Messages to find the consumer group with accumulated messages.
4. In the navigation pane, choose Consumer Groups.
5. Check whether there are consumers in the consumer group where messages are accumulated. If yes, contact the service party to accelerate their consumption. If no, contact the customer to delete unused consumer groups.

Solution 2:

1. Log in to the Kafka console and click the instance for which the alarm is generated. The instance details page is displayed.
2. In the left navigation pane, choose Analysis & Diagnosis > Accumulation Diagnosis.
3. Select the consumer groups and topics to be diagnosed, and click Pre-check.
4. After the pre-check is complete, if there are any risks in the Accumulated Messages area and the consumer group is not consuming message in the assign mode, click Start Diagnosis.
5. After the diagnosis, locate the row that contains the diagnosis result, and click View Details in the Operation column. The Diagnosis Details page is displayed. Check the possible causes, affected partitions or brokers, and suggestions. Follow the suggestions to handle message accumulation.