Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-14023 Percentage of Total Reserved Disk Space for Replicas Exceeds the Threshold
Updated on 2026-09-24 GMT+08:00
View PDF
Share

ALM-14023 Percentage of Total Reserved Disk Space for Replicas Exceeds the Threshold

Alarm Description

The system checks the percentage of total reserved disk space for replicas (Total reserved disk space for replicas/[Total reserved disk space for replicas + Total remaining disk space]) every 30 seconds and compares the actual percentage with the threshold. This alarm is generated when the percentage of total reserved disk space for replicas exceeds the threshold for multiple consecutive times (Trigger Count).

The alarm is cleared in the following two scenarios: The value of Trigger Count is 1 and the percentage of total reserved disk space for replicas is no more than the threshold; the value of Trigger Count is greater than 1 and the percentage of total reserved disk space for replicas is no more than 90% of the threshold.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

14023

Major (default threshold: 95%)

Minor (default threshold: 90%)

Yes

Alarm Parameters

Parameter

Description

Source

Specifies the cluster for which the alarm was generated.

ServiceName

Specifies the service for which the alarm was generated.

RoleName

Specifies the role for which the alarm was generated.

NameServiceName

Specifies the NameService for which the alarm was generated.

Trigger condition

Specifies the threshold for triggering the alarm.

Impact on the System

The performance of writing data to HDFS is affected. If all unused DataNode space is reserved for replicas, writing HDFS data fails.

Possible Causes

  • The alarm threshold is improperly configured.
  • The disk space configured for the HDFS cluster is insufficient.
  • The volume of services that access HDFS is too large and therefore DataNode is overloaded.

Handling Procedure

Check whether the alarm threshold is appropriate.

  1. On the FusionInsight Manager portal, choose O&M > Alarm > Thresholds > Name of the desired cluster > HDFS > Disk > Percentage of Reserved Space for Replicas of Unused Space to check whether the alarm threshold is appropriate. (The default threshold is 90%. You can change it as required.)

  2. Choose O&M > Alarm > Thresholds > Name of the desired cluster > HDFS > Disk > Percentage of Reserved Space for Replicas of Unused Space and Click Modify to change the threshold based on the actual usage.

    Figure 1 Modify Thresholds

  3. Wait 5 minutes and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to Step 4.

Check whether an alarm indicating insufficient disk space is generated.

  1. On the FusionInsight Manager, choose O&M > Alarm > Alarms and check whether ALM-14001 HDFS Disk Usage Exceeds the Threshold or ALM-14002 DataNode Disk Usage Exceeds the Threshold is generated.

  2. Rectify the fault by referring to ALM-14001 HDFS Disk Usage Exceeds the Threshold or ALM-14002 DataNode Disk Usage Exceeds the Threshold. Check whether the alarm is cleared.

  3. Wait 5 minutes and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to Step 7.

Expand the DataNode capacity.

  1. Expand the DataNode capacity .
  2. Wait 5 minutes and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to Step 9.

Collect fault information.

  1. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
  2. Expand the Service drop-down list and select HDFS for the target cluster.
  3. Click in the upper right corner, and set Start Date and End Date for log collection to 20 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Send the collected fault logs to O&M personnel for help.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None

Parent Topic: MRS Cluster Alarm Handling Reference