On this page
Help Center/ Data Lake Insight/ FAQs/ Problems Related to Spark Jobs/ Job O&M Errors/ Why Does the DataSource Syntax Fail to Create an OBS Table in Avro Format When Spark 2.3.x Is Used?

Why Does the DataSource Syntax Fail to Create an OBS Table in Avro Format When Spark 2.3.x Is Used?

Updated on 2023-05-19 GMT+08:00

Symptom

I failed to use the DataSource syntax to create an OBS table in Avro format when selecting Spark to access metadata.

Figure 1 Failed to create an OBS table in Avro format

Possible Causes

Spark 2.3.x does not support creating OBS tables in Avro format.

Solution

When using the DataSource syntax to create an OBS table in Avro format, select Spark 2.4.x or later.

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback