Supported Data Sources
The following table lists the data sources supported by real-time migration jobs.
Category |
Source |
Destination |
Synchronization Scenario |
Reference |
Description |
---|---|---|---|---|---|
Relational data |
MySQL Deployment mode: standalone, primary/standby (connected to the primary database), or PXC Deployment method: on-premises, other clouds, RDS, or GaussDB |
Hadoop: MRS Hudi, Doris (in internal test), and StarRocks (in internal test) |
Entire DB Database/Table shard (not supported when the destination is StarRocks) |
|
|
Message system: DMS for Kafka |
Entire DB Database/Table shard |
|
|||
Data warehouse: DWS |
Entire DB Database/Table shard |
|
|||
Search: Elasticsearch (in internal beta) |
Entire DB Database/Table shard |
Configuring a Job for Synchronizing Data from MySQL to Elasticsearch (Internal Test) |
|
||
SQL Server Deployment mode: standalone or primary/standby (connected to the primary database) Deployment method: on-premises, other clouds, or RDS |
Data warehouse: DWS (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
|
||
Hadoop: MRS Hudi (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
|
|||
PostgreSQL Deployment mode: standalone or primary/standby (connected to the primary database) Deployment method: on-premises, other clouds, or RDS |
Data warehouse: DWS (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB Database/Table shard |
|
||
Hadoop: MRS Hudi (in OBT) and Doris (in internal beta)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
|
|
||
Open Gauss (GaussDB) Deployment mode: centralized standalone, centralized primary/standby (connected to the primary database), and distributed primary/standby (connected to the primary database) Deployment mode: Huawei Cloud GaussDB |
Data warehouse: DWS (in OBT) |
Entire DB |
|
||
Hadoop: MRS Hudi |
Entire DB |
|
|||
Message system: DMS for Kafka
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
Configuring a Job for Synchronizing Data from a Centralized/Distributed GaussDB to DMS for Kafka |
|
||
Oracle Deployment mode: standalone or primary/standby (non-RAC architecture) Deployment method: on-premises |
Data warehouse: DWS (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
|
||
DMS for Kafka (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
Configuring a Job for Synchronizing Data from Oracle to DMS for Kafka |
|
||
Hadoop: MRS Hudi, Doris (in internal beta), and StarRocks (in internal beta)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB |
|
|
||
Message system |
DMS Kafka |
Object-based storage: Object Storage Service (OBS) |
Single table Entire DB |
Supported Kafka cluster versions: 2.7 and 3.x |
|
Apache Kafka Deployment method: on-premises or other clouds |
Hadoop: DMS for Kafka |
Entire DB |
Supported Kafka cluster versions: 2.7 and 3.x |
||
NoSQL |
MongoDB |
Data warehouse: DWS (in OBT)
NOTE:
This connection is available only after you apply for the whitelist membership. To use it, contact customer service or technical support. |
Entire DB Database/Table shard |
Configuring a Job for Synchronizing Data from MongoDB to DWS |
|
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot