Help Center>
Data Lake Insight>
FAQs>
Problems Related to Spark Jobs>
Job O&M Errors>
Why Does the DataSource Syntax Fail to Create an OBS Table in Avro Format When Spark 2.3.x Is Used?
Updated on 2023-05-19 GMT+08:00
Why Does the DataSource Syntax Fail to Create an OBS Table in Avro Format When Spark 2.3.x Is Used?
Symptom
I failed to use the DataSource syntax to create an OBS table in Avro format when selecting Spark to access metadata.
Figure 1 Failed to create an OBS table in Avro format
Possible Causes
Spark 2.3.x does not support creating OBS tables in Avro format.
Solution
When using the DataSource syntax to create an OBS table in Avro format, select Spark 2.4.x or later.
Parent topic: Job O&M Errors
Job O&M Errors FAQs
- What Can I Do When Receiving java.lang.AbstractMethodError in the Spark Job?
- Why Are Errors "ResponseCode: 403" and "ResponseStatus: Forbidden" Reported When a Spark Job Accesses OBS Data?
- Why Is Error "verifyBucketExists on XXXX: status [403]" Reported When I Use a Spark Job to Access an OBS Bucket That I Have Access Permission?
- Why Is a Job Running Timeout Reported When a Spark Job Runs a Large Amount of Data?
- Why Does the Job Fail to Be Executed and the Log Shows that the File Directory Is Abnormal When I Use a Spark Job to Access Files in SFTP?
- Why Does the Job Fail to Be Executed Due to Insufficient Database and Table Permissions?
- Why Can't I Find the global_temp Database in the Spark 3.x Job Log?
- Why Does the DataSource Syntax Fail to Create an OBS Table in Avro Format When Spark 2.3.x Is Used?
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.
The system is busy. Please try again later.
more
