Spark Shuffle Exception Handling
Question
In some scenarios, the following exception occurs in the Spark shuffle phase:

Solution
For JDBC:
Log in to FusionInsight Manager, change the value of the JDBCServer parameter spark.authenticate.enableSaslEncryption to false, and restart the corresponding instance.
For client jobs:
When the client submits the application, change the value of spark.authenticate.enableSaslEncryption in the spark-defaults.conf file to false.
Last Article: Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline?
Next Article: Using Storm
Did this article solve your problem?
Thank you for your score!Your feedback would help us improve the website.