Help Center/ Data Lake Insight/ FAQs/ Flink Jobs/ Usage/ What Data Formats and Data Sources Are Supported by DLI Flink Jobs?

Updated on 2024-01-23 GMT+08:00

View PDF

What Data Formats and Data Sources Are Supported by DLI Flink Jobs?

DLI Flink jobs support the following data formats:

Avro, Avro_merge, BLOB, CSV, EMAIL, JSON, ORC, Parquet, and XML.

DLI Flink jobs support data from the following data sources:

CloudTable HBase, CloudTable OpenTSDB, CSS Elasticsearch, DCS, DDS, DIS, DMS, GaussDB(DWS), EdgeHub, MRS HBase, MRS Kafka, open-source Kafka, file systems, OBS, RDS, and SMN

**Table 1** Supported source and sink streams of corresponding data formats
Data Format	Supported Source Stream	Supported Sink Stream
Avro	-	OBS Sink Stream
Avro_merge	-	OBS Sink Stream
BLOB	DIS Source Stream MRS Kafka Source Stream Open-Source Kafka Source Stream	-
CSV	DIS Source Stream OBS Source Stream Open-Source Kafka Source Stream	DIS Sink Stream OBS Sink Stream GaussDB(DWS) Sink Stream (OBS Mode) Open-Source Kafka Sink Stream File System Sink Stream
EMAIL	DIS Source Stream	-
JSON	DIS Source Stream OBS Source Stream MRS Kafka Source Stream Open-Source Kafka Source Stream	DIS Sink Stream OBS Sink Stream MRS Kafka Sink Stream Open-Source Kafka Sink Stream
ORC	-	OBS Sink Stream GaussDB(DWS) Sink Stream (OBS Mode)
Parquet	-	OBS Sink Stream File System Sink Stream
XML	DIS Source Stream	-

Parent topic: Usage

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot