Updated on 2024-01-17 GMT+08:00

ALM-38002 Heap Memory Usage of Kafka Exceeds the Threshold (For MRS 2.x or Earlier)

Description

The system checks the heap memory usage of Kafka every 30 seconds. This alarm is generated if the heap memory usage of Kafka exceeds the threshold (80%).

This alarm is cleared if the heap memory usage is lower than the threshold.

Attribute

Alarm ID

Alarm Severity

Auto Clear

38002

Major

Yes

Parameters

Parameter

Description

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Trigger Condition

Generates an alarm when the actual indicator value exceeds the specified threshold.

Impact on the System

Memory overflow may occur, causing service crashes.

Possible Causes

The heap memory usage is high or the heap memory is improperly allocated.

Procedure

  1. Check the heap memory usage.

    1. Go to the MRS cluster details page and choose Alarms.
    2. Choose ALM-38002 Kafka Heap Memory Usage Exceeds the Threshold > Location. Query the IP address of the alarmed instance.
    3. Choose Components > Kafka > Instance > Broker (corresponding to the IP address of the alarmed instance) > Customize > Kafka Heap Memory Resource Percentage to check the heap memory usage.
    4. Check whether the heap memory usage of Kafka has reached the threshold (80%).
      • If yes, go to 1.e.
      • If no, go to 2.
    5. Choose Components > Kafka > Service Configuration > All > Broker > Environment Variables. Increase the value of KAFKA_HEAP_OPTS as required.
    6. Check whether the alarm is cleared.
      • If yes, no further action is required.
      • If no, go to 2.

  2. Collect fault information.

    1. On MRS Manager, choose System > Export Log.
    2. Contact the O&M engineers and send the collected logs.

Related Information

N/A