# Yarn-cluster模式下提交Spark任务报"Can't get the Kerberos realm"异常
#### 问题现象
认证异常导致提交Spark任务失败，报"Can't get the Kerberos realm"异常。
#### 原因分析
1. 在Driver端打印异常找不到连接HDFS的Token信息，报错如下：
   ```
   16/03/22 20:37:10 WARN Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 192 for admin) can't be found in cache
   16/03/22 20:37:10 WARN Client: Failed to cleanup staging dir .sparkStaging/application_1458558192236_0003
   org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token 192 for admin) can't be found in cache
   ```
   
2. 在Yarn原生页面显示ApplicationMaster启动两次均失败，任务退出。
   图1ApplicationMaster启动失败   
   ![](https://support.huaweicloud.com/trouble-mrs/zh-cn_image_0264281830.png "点击放大") 
3. 查看ApplicationMaster日志看到如下异常信息：
   ```
   Exception in thread "main" java.lang.ExceptionInInitializerError
   Caused by: org.apache.spark.SparkException: Unable to load YARN support
   Caused by: java.lang.IllegalArgumentException: Can't get Kerberos realm
   Caused by: java.lang.reflect.InvocationTargetException
   Caused by: KrbException: Cannot locate default realm
   Caused by: KrbException: Generic error (description in e-text) (60) - Unable to locate Kerberos realm
   org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1410)
   ... 86 more
   Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception caught.
   NestedThrowables:java.lang.reflect.InvocationTargetException
   ... 110 more
   ```
   
4. 执行**./spark-submit --class** *yourclassname* **--master yarn-cluster /** *yourdependencyjars*任务以yarn-cluster模式提交任务，Driver端会在集群中启动，由于加载的是客户端的spark.driver.extraJavaOptions，在集群节点上对应路径下找不到对应的kdc.conf文件，无法获取kerberos认证所需信息，导致ApplicationMaster启动失败。
 
#### 处理步骤
在客户端提交任务时，在命令行中配置自定义的spark.driver.extraJavaOptions参数这样任务运行时就不会自动加载客户端路径下"spark-defaults.conf"中的spark.driver.extraJavaOptions；或者在启动Spark任务时，通过"--conf"来指定Driver的配置，如下（此处spark.driver.extraJavaOptions"="号后面的引号部分不能缺少）。
**./spark-submit -class yourclassname --master yarn-cluster --conf spark.driver.extraJavaOptions="**
**-Dlog4j.configuration=file:/opt/client/Spark/spark/conf/log4j.properties -Djetty.version=x.y.z -Dzookeeper.server.principal=zookeeper/hadoop.794bbab6_9505_44cc_8515_b4eddc84e6c1.com -Djava.security.krb5.conf=/opt/client/KrbClient/kerberos/var/krb5kdc/krb5.conf -Djava.security.auth.login.config=/opt/client/Spark/spark/conf/jaas.conf -Dorg.xerial.snappy.tempdir=/opt/client/Spark/tmp -Dcarbon.properties.filepath=/opt/client/Spark/spark/conf/carbon.properties" ../yourdependencyjars**