Doris JDBC and StreamLoad Write Modes

Application Scenarios

DataArts Migration can write data to Doris using the JDBC or StreamLoad mode. You can select a mode that suits your needs.

JDBC

• Characteristics:
  • Universality: JDBC is a standard database connection mode and is applicable to most databases that support JDBC.
  • Flexibility: It supports complex SQL operations, such as data insertion, update, and deletion.
  • Ease of use: It is user-friendly and easy to understand and use.
• Scenarios:
  • Small-scale data write: operations on a small amount of data, for example, insertion of a single piece of data or a small amount of data
  • Complex data operations: Complex SQL statements need to be executed, for example, insertion and update operations with conditions.
  • Integration with other systems: It can be used by DataArts Migration to interact with multiple database systems.
• Example:

  INSERTINTO my_table (column1, column2)VALUES(value1, value2);

StreamLoad

• Characteristics:
  • High efficiency: StreamLoad is an efficient data import method provided by Doris and can quickly write data in batches.
  • Stream write: Data is written to Doris in streams, which is suitable for continuous import of a large amount of data.
• Scenarios:

  Import of a large amount of data: This mode is suitable for importing a large amount of data quickly, for example, batch loading of data to a data warehouse.

• Example:

  curl --location-trusted -XPUT -T data.csv 'http://<fe_host>:8030/api/my_database/my_table/_stream_load'