On this page

Show all

Help Center/ Data Ingestion Service/ FAQs/ Dump Questions/ How Does a Schema Support Default Fields or NULL Fields?

How Does a Schema Support Default Fields or NULL Fields?

Updated on 2024-10-25 GMT+08:00

View PDF

A source data schema is a user's JSON data sample used to describe the JSON data format. DIS can generate the Avro schema based on the JSON data sample. By default, the default field or NULL is not supported, as shown in Figure 1.

Figure 1 Example of not supporting the default field
Click to enlarge

The type of the key1 field is String (type: string in Avro Schema). If the key1 field in the source data is not transferred or the transferred value is null, the dump task reports an error.

To enable the schema generated based on the JSON data sample supports the default value or null, select the Convert and Move and click Convert Source Data Sample, as shown in Figure 2.

Figure 2 Example of supporting the default field
Click to enlarge

In this case, the type of the key1 field is Union (type: [null, string] in Avro Schema). If the key1 field in the source data is not transferred or the transferred value is null, null is automatically filled as the default value. The dump task can properly convert the format.

Parent topic: Dump Questions

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot