# HDFS故障排除
本章节汇总了使用HDFS时遇到的常见故障及故障处理方法。
- **HDFS组件异常：**
  - [HDFS容量达到100%导致上层服务HBase、Spark等不可用](https://support.huaweicloud.com/trouble-mrs/mrs_03_0047.html)
  
  - [启动HDFS和Yarn服务报错"Permission denied"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0048.html)
  
  - [集群外节点访问MRS HDFS报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0733.html)
   
- **NameNode实例异常** **：**
  - [修改RPC端口后HDFS NameNode实例都变为备状态](https://support.huaweicloud.com/trouble-mrs/mrs_03_0035.html)
  
  - [内存不足导致HDFS NameNode启动失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0075.html)
  
  - [单NameNode长期故障时如何使用客户端手动checkpoint](https://support.huaweicloud.com/trouble-mrs/mrs_03_0078.html)
  
  - [删除大量文件后重启NameNode耗时长](https://support.huaweicloud.com/trouble-mrs/mrs_01_1691.html)
  
  - [EditLog不连续导致NameNode启动失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_1709.html)
  
  - [当备NameNode存储元数据时，断电后备NameNode启动失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_1698.html)
  
  - [备NameNode节点长时间未启动，导致启动失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_2493131.html)
   
- **DataNode实例异常：**
  - [HDFS的DataNode一直显示退服中](https://support.huaweicloud.com/trouble-mrs/mrs_03_0132.html)
  
  - [DataNode偶现CPU占用接近100%导致节点无法连接](https://support.huaweicloud.com/trouble-mrs/mrs_03_0077.html)
  
  - [由于HDFS块丢失导致DataNode退服失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0740.html)
  
  - [dfs.datanode.data.dir中定义的磁盘数量等于dfs.datanode.failed.volumes.tolerated的值时，DataNode启动失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_1696.html)
   
- **文件读写异常** **：**
  - [HDFS写文件失败，报错"item limit of xxx is exceeded"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0085.html)
  
  - [HDFS读写文件失败，报错"Failed to place enough replicas"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0079.html)
  
  - [HDFS读取文件失败，报错"FileNotFoundException"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0084.html)
  
  - [HDFS读文件失败，报错"No common protection layer"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0087.html)
  
  - [HDFS写数据时报错"java.net.SocketException"](https://support.huaweicloud.com/trouble-mrs/mrs_01_1705.html)
  
  - [HDFS写文件并发较大时报副本不足](https://support.huaweicloud.com/trouble-mrs/mrs_03_0291.html)
  
  - [HDFS客户端写文件close失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0081.html)
  
  - [HDFS目录配额不足导致写文件失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0088.html)
  
  - [文件错误导致上传文件到HDFS失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0082.html)
  
  - [集群外节点安装客户端上传HDFS文件失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0259.html)
  
  - [查询或者删除HDFS文件失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0090.html)
  
  - [文件最大打开句柄数设置太小导致读写文件异常](https://support.huaweicloud.com/trouble-mrs/mrs_03_0080.html)
   
- **客户端使用异常：**
  - [调整HDFS Shell客户端日志级别](https://support.huaweicloud.com/trouble-mrs/mrs_03_0086.html)
  
  - [使用普通模式集群的HDFS客户端时报错"error creating DomainSocket"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0206.html)
  
  - [执行distcp跨集群拷贝文件报错"Source and target differ in block-size"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0089.html)
  
  - [使用distcp命令拷贝空文件夹报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0766.html)
  
  - [HDFS客户端无法删除超长目录](https://support.huaweicloud.com/trouble-mrs/mrs_03_0319.html)
  
  - [HDFS调用FileInputFormat的getsplit的时候出现数组越界](https://support.huaweicloud.com/trouble-mrs/mrs_01_1700.html)
   
- **数据块异常：**
  - [ntpdate修改时间导致HDFS出现大量丢块](https://support.huaweicloud.com/trouble-mrs/mrs_03_0076.html)
  
  - [界面配置dfs.blocksize后上传数据，block大小未改变](https://support.huaweicloud.com/trouble-mrs/mrs_03_0083.html)
   
- **网络连接异常：**
  - [通过公网IP连接使用HDFS客户端报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0039.html)
  
  - [使用Python远程连接HDFS的端口失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0046.html)
   
- **数据均衡/磁盘均衡异常：**
  - [执行balance常见问题定位方法](https://support.huaweicloud.com/trouble-mrs/mrs_03_0094.html)
  
  - [非HDFS数据残留导致数据分布不均衡](https://support.huaweicloud.com/trouble-mrs/mrs_03_0091.html)
  
  - [HDFS客户端安装在数据节点导致数据分布不均衡](https://support.huaweicloud.com/trouble-mrs/mrs_03_0092.html)
  
  - [节点内DataNode磁盘使用率不均衡](https://support.huaweicloud.com/trouble-mrs/mrs_03_0093.html)
  
  - [HDFS显示磁盘空间不足，其实还有10%磁盘空间](https://support.huaweicloud.com/trouble-mrs/mrs_03_0095.html)
   
- **告警异常：**
  - [NameNode节点存在ALM-12027主机PID使用率超过阈值告警](https://support.huaweicloud.com/trouble-mrs/mrs_03_0735.html)
  
  - [集群出现ALM-14012 Journalnode数据不同步告警](https://support.huaweicloud.com/trouble-mrs/mrs_03_0743.html)