Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ Troubleshooting/ Using HDFS/ HDFS Displays Insufficient Disk Space But 10% Disk Space Remains
Updated on 2022-12-14 GMT+08:00
View PDF
Share

HDFS Displays Insufficient Disk Space But 10% Disk Space Remains

Symptom

  1. The alarm "HDFS Disk Usage Exceeds the Threshold" is reported.
  2. On the HDFS page, high disk space usage is displayed.

Cause Analysis

The dfs.datanode.du.reserved.percentage parameter is set in HDFS, indicating the percentage of the reserved space of each disk to the total disk space. The DataNode reserves space you set for NodeManager running and computing of other components, for example, Yarn, or for upgrades.

As 10% disk space is reserved, the HDFS DataNode regards that there is no available disk space when the disk usage reaches 90%.

Solution

  1. Expand the HDFS DataNode disk capacity when its usage reaches 80%.
  2. If the disk capacity cannot be expanded in time, delete useless data in HDFS to release disk space.
Parent topic: Using HDFS