Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-18029 Total Size of Files in the Yarn-nm-state Directory of NodeManager Exceeds the Threshold
Updated on 2026-09-24 GMT+08:00
View PDF
Share

ALM-18029 Total Size of Files in the Yarn-nm-state Directory of NodeManager Exceeds the Threshold

Alarm Description

NodeManager checks every 30 seconds if the total size of files in the yarn-nm-state directory on the node where the instance is deployed exceeds 100 MB. This alarm is triggered when the total size exceeds 100 MB.

This alarm is cleared when the total size of files in the yarn-nm-state directory on the node where the NodeManager instance is deployed is less than 100 MB.

This section applies to MRS 3.6.0-LTS and later versions.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

18029

Major

Yes

Alarm Parameters

Type

Parameter

Description

Location Information

Source

Specifies the cluster for which the alarm was generated.

ServiceName

Specifies the service for which the alarm was generated.

RoleName

Specifies the role for which the alarm was generated.

HostName

Specifies the host for which the alarm was generated.

Additional Information

Trigger Condition

The total size of files in the yarn-nm-state directory on the node where the NodeManager instance is deployed exceeds 100 MB.

Impact on the System

A large number of useless Container heartbeats may be generated, affecting ResourceManager's overall task scheduling.

Possible Causes

The Container information of the NodeManager node is not cleared.

Handling Procedure

Clear the residual Container information on the NodeManager node.

  1. Log in to FusionInsight Manager, and choose O&M > Alarm > Alarms. Click the hostname reported in the alarm details to obtain the service IP address of the host.
  2. Choose Cluster > Services > Yarn > Instances. Select the NodeManager instances with the same IP address as the one you obtained in Step 1, choose More > Stop Instance, and stop the instance as prompted.
  1. Log in to the host for which the alarm is reported as user root, using the service IP address obtained in Step 1, and run the following command to switch to user omm:

    su - omm

  2. Run the following command to clear files in the yarn-nm-state directory:

    rm -rf ${SRV_HOME}/tmp/yarn-nm-recovery/yarn-nm-state/*

  3. On FusionInsight Manager, choose Cluster > Services > Yarn > Instances, check the NodeManager instance for which the alarm is reported, click Start Instance, and start the instance as prompted.
  4. Wait 5 minutes and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to Step 7.

  5. Contact O&M engineers to rectify the fault.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None

Parent Topic: MRS Cluster Alarm Handling Reference