# Spark故障排除
本章节汇总了使用Spark时遇到的常见故障及故障处理方法。
- **Spark任务提交常见故障**
  - [Spark任务提交失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0284.html)
  
  - [Spark Streaming任务提交失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0288.html)
  
  - [提交Spark任务时提示参数格式错误](https://support.huaweicloud.com/trouble-mrs/mrs_03_0029.html)
  
  - [提交Spark任务时报错"ClassNotFoundException"](https://support.huaweicloud.com/trouble-mrs/mrs_03_0043.html)
  
  - [提交Spark任务时Driver端提示运行内存超限](https://support.huaweicloud.com/trouble-mrs/mrs_03_0109.html)
  
  - [Yarn-cluster模式下提交Spark任务报"Can't get the Kerberos realm"异常](https://support.huaweicloud.com/trouble-mrs/mrs_03_0110.html)
  
  - [Yarn-client模式提交Spark任务时ApplicationMaster尝试启动两次失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0112.html)
  
  - [通过API提交Spark作业后作业状态为error](https://support.huaweicloud.com/trouble-mrs/mrs_03_0237.html)
  
  - [提交Spark任务时连接ResourceManager异常](https://support.huaweicloud.com/trouble-mrs/mrs_03_0131.html)
  
  - [集群外节点提交Spark作业时报错无法连接Driver](https://support.huaweicloud.com/trouble-mrs/mrs_03_0269.html)
   
- **Spark任务运行常见故障**
  - [Spark任务运行失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0285.html)
  
  - [运行Spark应用时修改MapReduce分片值报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0025.html)
  
  - [引入jar包不正确导致Spark任务无法运行](https://support.huaweicloud.com/trouble-mrs/mrs_03_0037.html)
  
  - [Spark任务由于内存不足或未添加Jar包导致异常](https://support.huaweicloud.com/trouble-mrs/mrs_03_0038.html)
  
  - [通过DataArts Studio调度Spark作业失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0218.html)
  
  - [运行Spark任务发现大量shuffle结果丢失](https://support.huaweicloud.com/trouble-mrs/mrs_03_0274.html)
  
  - [查看Spark任务日志失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0287.html)
  
  - [Spark Streaming任务失败但是Yarn WebUI中显示状态为成功](https://support.huaweicloud.com/trouble-mrs/mrs_03_0825.html)
  
  - [多次运行Spark应用程序引发JRE错误](https://support.huaweicloud.com/trouble-mrs/mrs_01_2060.html)
  
  - [Spark shuffle异常处理](https://support.huaweicloud.com/trouble-mrs/mrs_01_24176.html)
   
- **Spark组件异常常见故障**
  - [节点磁盘容量不足导致Spark服务不可用](https://support.huaweicloud.com/trouble-mrs/mrs_03_0036.html)
  
  - [JDK版本不匹配导致启动spark-sql和spark-shell失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0111.html)
  
  - [在spark-beeline中创建或删除表失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0270.html)
  
  - [spark-beeline查询Hive视图报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0730.html)
  
  - [通过spark-beeline指定location到OBS建表失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_2340.html)
  
  - [通过spark-shell加载数据到Hive表失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0283.html)
  
  - [SparkSQL读取ORC表报错](https://support.huaweicloud.com/trouble-mrs/mrs_03_0296.html)
  
  - [通过Spark-sql创建Hudi表或者Hive表，未插入数据前查询表统计信息为空](https://support.huaweicloud.com/trouble-mrs/mrs_01_249161.html)
  
  - [Spark WebUI页面无法跳转到任务日志页面](https://support.huaweicloud.com/trouble-mrs/mrs_03_0301.html)
  
  - [访问Spark应用获取的restful接口信息有误](https://support.huaweicloud.com/trouble-mrs/mrs_01_2055.html)
  
  - [从Yarn Web UI页面无法跳转到Spark Web UI界面](https://support.huaweicloud.com/trouble-mrs/mrs_01_2056.html)
  
  - [加载空的part文件时，app无法显示在JobHistory的页面上](https://support.huaweicloud.com/trouble-mrs/mrs_01_2058.html)
  
  - [Spark导出带有相同字段名的表失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_2059.html)
  
  - [对同一目录创建多个外表导致外表查询失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_2063.html)
  
  - [使用集群外客户端连接Spark端口失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_248952.html)
  
  - [Datasource Avro格式查询异常](https://support.huaweicloud.com/trouble-mrs/mrs_01_248983.html)
  
  - [建表语句分区列为timestamp时，使用非标准格式的时间指定分区查询表统计失败](https://support.huaweicloud.com/trouble-mrs/mrs_01_249238.html)
  
  - [SQL语法兼容TIMESTAMP/DATE特殊字符](https://support.huaweicloud.com/trouble-mrs/mrs_01_249250.html)
   
- **Spark权限认证常见故障**
  - [Spark连接HBase认证错误](https://support.huaweicloud.com/trouble-mrs/mrs_03_0289.html)
  
  - [Spark连接Kafka认证错误](https://support.huaweicloud.com/trouble-mrs/mrs_03_0295.html)
  
  - [Spark如何访问外部集群组件](https://support.huaweicloud.com/trouble-mrs/mrs_01_2062.html)
   
- **JDBCServer常见故障**
  - [JDBCServer连接失败](https://support.huaweicloud.com/trouble-mrs/mrs_03_0286.html)
  
  - [JDBCServer节点磁盘空间不足导致实例异常](https://support.huaweicloud.com/trouble-mrs/mrs_01_300586.html)
   
- **JobHistory常见故障**
  - [MRS集群反复上报JobHistory进程堆内存使用超出阈值告警](https://support.huaweicloud.com/trouble-mrs/mrs_03_0265.html)
  
  - [HistoryServer缓存的应用被回收，导致此类应用页面访问时出错](https://support.huaweicloud.com/trouble-mrs/mrs_01_2057.html)
  
  - [访问Spark JobHistory中某个应用的原生页面时页面显示错误](https://support.huaweicloud.com/trouble-mrs/mrs_01_2064.html)