Help Center/ MapReduce Service/ User Guide (ME-Abu Dhabi Region)/ Troubleshooting/ Using HDFS/ Uneven Data Distribution Due to Non-HDFS Data Residuals
Updated on 2022-02-22 GMT+08:00

Uneven Data Distribution Due to Non-HDFS Data Residuals

Symptom

Data distribution is uneven. A disk is full while other disks have sufficient space.

The data storage directory of HDFS DataNode is set to /export/data1/dfs--/export/data12/dfs. A large volume of data is stored to /export/data1/dfs but data is evenly distributed to other disks.

Cause Analysis

The customer's disk is reinstalled. However, a directory is not thoroughly deleted during disk uninstallation, that is, the added disk is unformatted and historical junk data remains.

Solution

Manually delete data residuals.