Why DataArtsStudio Occasionally Fail to Schedule Spark Jobs and the Rescheduling also Fails?

Symptom

DataArtsStudio occasionally fails to schedule Spark jobs and the rescheduling also fails. The following error information is displayed:

Caused by: org.apache.spark.SparkException: Application application_1619511926396_2586346 finished with failed status

Solution

Log in to the node where the Spark client is located as user root and increase the value of the spark.driver.memory parameter in the spark-defaults.conf file.