Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-18008 Heap Memory Usage of Yarn ResourceManager Exceeds the Threshold (For MRS 2.x or Earlier)
Updated on 2024-09-23 GMT+08:00
View PDF
Share

ALM-18008 Heap Memory Usage of Yarn ResourceManager Exceeds the Threshold (For MRS 2.x or Earlier)

Description

The system checks the heap memory usage of Yarn ResourceManager every 30 seconds and compares the actual usage with the threshold. The alarm is generated when the heap memory usage of Yarn ResourceManager exceeds the threshold (80% of the maximum memory by default).

To change the threshold, choose System > Threshold Configuration > Service > Yarn. The alarm is cleared when the heap memory usage is less than or equal to the threshold.

Attribute

Alarm ID

Alarm Severity

Auto Clear

18008

Major

Yes

Parameters

Parameter

Description

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Trigger Condition

Specifies the threshold for triggering the alarm.

Impact on the System

When the heap memory usage of Yarn ResourceManager is overhigh, the performance of Yarn task submission and operation is affected. What is more, a memory overflow occurs so that the Yarn service is unavailable.

Possible Causes

The heap memory of the Yarn ResourceManager instance on the node is overused or the heap memory is inappropriately allocated. As a result, the usage exceeds the threshold.

Procedure

  1. Check the heap memory usage.

    1. Go to the MRS cluster details page and choose Alarms.
    2. Select the alarm whose Alarm ID is 18008 and view the IP address and role name of the instance in Location.
    3. Choose Components > Yarn > Instances > ResourceManager (IP address of the instance for which the alarm is generated) > Customize > Percentage of Used Heap Memory of the ResourceManager. Check the heap memory usage.
    4. Check whether the heap memory usage of ResourceManager has reached the threshold (80% of the maximum memory).
      • If yes, go to 1.e.
      • If no, go to 2.
    5. Choose Components > Yarn > Service Configuration. Set Type to All and choose ResourceManager > System. Change the values of -Xmx and -Xms in the GC_OPTS parameter based on the site requirements to ensure that the value of -Xms is less than that of -Xmx. Click Save Configuration and select Restart Role Instance. Click OK.
    6. Check whether the alarm is cleared.
      • If yes, no further action is required.
      • If no, go to 2.

  2. Collect fault information.

    1. On MRS Manager, choose System > Export Log.
    2. Contact the O&M engineers and send the collected logs.

Reference

None