Help Center> MapReduce Service> Troubleshooting> Using Spark> Job Status Is error After a Spark Job Is Submitted Through an API

Updated on 2023-11-30 GMT+08:00

View PDF

Job Status Is error After a Spark Job Is Submitted Through an API

Issue

After a Spark job is submitted using an API, the job status is displayed as error.

Symptom

After the log level in /opt/client/Spark/spark/conf/log4j.properties is changed and a job is submitted using API V1.1, the job status is displayed as error.

Cause Analysis

The executor monitors the job log output and determines the job execution result. After the execution result is changed to error, the output result cannot be detected. Therefore, the executor determines that the job status is abnormal after the job expires.

Procedure

Change the log level in the /opt/client/Spark/spark/conf/log4j.properties file to info.

Summary and Suggestions

You are advised to use the V2 API to submit jobs.

Parent topic: Using Spark

Previous topic: DataArts Studio Failed to Schedule Spark Jobs

Next topic: ALM-43006 Is Repeatedly Reported for the MRS Cluster

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.