ALM-14024 Tenant Space Usage Exceeds the Threshold

Alarm Description

The system checks the space usage (used space of each directory/space allocated to each directory) of each directory associated with a tenant every hour and compares the space usage of each directory with the threshold set for the directory. This alarm is generated when the space usage exceeds the threshold.

This alarm is cleared when the space usage is less than or equal to the threshold.

Alarm Attributes

Alarm Parameters

Impact on the System

This alarm is generated if the space usage of the tenant directory exceeds the custom threshold. File writing to the directory is not affected. If the used space exceeds the maximum storage space allocated to the directory, the HDFS fails to write data to the directory.

Possible Causes

• The alarm threshold is improperly configured.
• The space allocated to the tenant is improper.

Handling Procedure

Check whether the alarm threshold is appropriate.

1. View the alarm location information to obtain the tenant name and tenant directory for which the alarm is generated.
2. On the FusionInsight Manager portal, choose the Tenant Resources page, select the tenant for which the alarm is generated, and click Resources. Check whether the storage space threshold configured for the tenant directory for which the alarm is generated is proper. (The default value 90% is a proper value. You can set it based on the site requirements.)
   • If yes, go to 5.
   • If no, go to 3.

3. On the Resources page, click Modify to modify or delete the storage space threshold.
4. About one minute later, check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to 5.

Check whether the space allocated to the tenant is appropriate.

5. On the FusionInsight Manager portal, choose the Tenant Resources page, select the tenant for which the alarm is generated, and click Resources. Check whether the storage space quota of the tenant directory for which the alarm is generated is proper based on the actual service status of the tenant directory.
   • If yes, go to 8.
   • If no, go to 6.

6. On the Resources page, click Modify to modify the storage space quota.
7. About one minute later, check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to 8.

Collect fault information.

8. On the FusionInsight Manager portal, choose O&M > Log > Download.
9. Select HDFS in the required cluster and NodeAgent under Manager from the Service.
10. Click in the upper right corner, and set Start Date and End Date for log collection to 20 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
11. Contact the O&M engineers and send the collected logs.

Alarm Clearance

After the fault is rectified, the system automatically clears this alarm.

Related Information

None.