Updated on 2025-02-27 GMT+08:00

Supported Data Sources

Table 1 lists the data sources supported by real-time migration jobs.

Table 1 Data sources supported by real-time migration jobs

Category

Source

Destination

Reference

Description

Relational data

MySQL

Hadoop: MRS Hudi

Configuring a Job for Synchronizing Data from MySQL to MRS Hudi

  • Recommended MySQL database versions: 5.6, 5.7, and 8.x
  • Recommended Hudi version: 0.11.0

Message system: DMS Kafka

Configuring a Job for Synchronizing Data from MySQL to Kafka

  • Recommended MySQL database versions: 5.6, 5.7, and 8.x

  • Recommended Kafka cluster versions: 2.7 and 3.x

Data warehouse: GaussDB(DWS)

Configuring a Job for Synchronizing Data from MySQL to GaussDB(DWS)

  • Recommended MySQL database versions: 5.6, 5.7, and 8.x

  • Recommended GaussDB(DWS) cluster versions: 8.1.3 and 8.2.0

SQL Server

Hadoop: MRS Hudi (in OBT)

NOTE:

This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support.

Configuring a Job for Synchronizing Data from SQL Server to MRS Hudi

  • Recommended SQL Server versions: Enterprise Edition 2016, 2017, 2019, and 2022; Standard Edition 2016 SP2 and later, 2017, 2019, and 2022)
  • Recommended Hudi version: 0.11.0

PostgreSQL

Data warehouse: GaussDB(DWS) (in OBT)

NOTE:

This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support.

Configuring a Job for Synchronizing Data from PostgreSQL to GaussDB(DWS)

  • Recommended PostgreSQL database versions: PostgreSQL 9.4, 9.5, 9.6, 10, 11, 12, 13, and 14
  • Recommended GaussDB(DWS) cluster versions: 8.1.3 and 8.2.0

Oracle

Data warehouse: GaussDB(DWS) (in OBT)

NOTE:

This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support.

Configuring a Job for Synchronizing Data from Oracle to GaussDB(DWS)

  • Recommended Oracle database versions: 10, 11, 12, and 19
  • Recommended GaussDB(DWS) cluster versions: 8.1.3 and 8.2.0

Hadoop: MRS Hudi (in OBT)

NOTE:

This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support.

Configuring a Job for Synchronizing Data from Oracle to MRS Hudi

  • Recommended Oracle database versions: 10, 11, 12, and 19
  • Recommended Hudi version: 0.11.0

Message system

DMS for Kafka

Object-based storage: Object Storage Service (OBS)

Configuring a Job for Synchronizing Data from DMS for Kafka to OBS

Recommended Kafka cluster versions: 2.7 and 3.x

Apache Kafka

Hadoop: MRS Kafka (in OBT)

NOTE:

This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support.

Configuring a Job for Synchronizing Data from Apache Kafka to MRS Kafka

Recommended Kafka cluster versions: 2.7 and 3.x