Uneven Data Distribution Due to Non-HDFS Data Residuals

Symptom

Data distribution is uneven. A disk is full while other disks have sufficient space.

The data storage directory of HDFS DataNode is set to /export/data1/dfs--/export/data12/dfs. A large volume of data is stored to /export/data1/dfs but data is evenly distributed to other disks.

Cause Analysis

The customer's disk is reinstalled. However, a directory is not thoroughly deleted during disk uninstallation, that is, the added disk is unformatted and historical junk data remains.

Solution

Manually delete data residuals.