ALM-38002 Heap Memory Usage of Kafka Exceeds the Threshold (For MRS 2.x or Earlier)

Description

The system checks the heap memory usage of Kafka every 30 seconds. This alarm is generated if the heap memory usage of Kafka exceeds the threshold (80%).

This alarm is cleared if the heap memory usage is lower than the threshold.

Attribute

Alarm ID	Alarm Severity	Auto Clear
38002	Major	Yes

Parameters

Parameter	Description
ServiceName	Specifies the service for which the alarm is generated.
RoleName	Specifies the role for which the alarm is generated.
HostName	Specifies the host for which the alarm is generated.
Trigger Condition	Generates an alarm when the actual indicator value exceeds the specified threshold.

Impact on the System

Memory overflow may occur, causing service crashes.

Possible Causes

The heap memory usage is high or the heap memory is improperly allocated.

Procedure

Check the heap memory usage.
1. Go to the MRS cluster details page and choose Alarms.
2. Choose ALM-38002 Kafka Heap Memory Usage Exceeds the Threshold > Location. Query the IP address of the alarmed instance.
3. Choose Components > Kafka > Instance > Broker (corresponding to the IP address of the alarmed instance) > Customize > Kafka Heap Memory Resource Percentage to check the heap memory usage.
4. Check whether the heap memory usage of Kafka has reached the threshold (80%).
  - If yes, go to 1.e.
  - If no, go to 2.
5. Choose Components > Kafka > Service Configuration > All > Broker > Environment Variables. Increase the value of KAFKA_HEAP_OPTS as required.
6. Check whether the alarm is cleared.
  - If yes, no further action is required.
  - If no, go to 2.
Collect fault information.
1. On MRS Manager, choose System > Export Log.
2. Contact the O&M engineers and send the collected logs.