Updated on 2024-12-01 GMT+08:00

Synchronization Overview

Real-time synchronization refers to the real-time flow of key service data from sources to destinations while consistency of data can be ensured.

It is different from migration. Migration means moving your overall database from one platform to another. Synchronization refers to the continuous flow of data between different services.

You can use real-time synchronization in many scenarios such as real-time analysis, report system, and data warehouse environment.

Real-time synchronization is mainly used for synchronizing tables and data. It can meet various requirements, such as many-to-one, one-to-many synchronization, dynamic addition and deletion of tables, and synchronization between tables with different names.

Figure 1 Real-time synchronization principle

Supported Database Types

The following table lists the source database and destination database types supported by DRS in real-time synchronization.

Table 1 Synchronization scheme

Source DB Type

Destination DB Type

Synchronization Mode

Related Documents

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds
  • RDS for MySQL

RDS for MySQL

Incremental

Full

Full+Incremental

From MySQL to MySQL (To the cloud)

GaussDB(for MySQL)

Incremental

Full+Incremental

From MySQL to GaussDB(for MySQL)

RDS for PostgreSQL

Full

Full+Incremental

From MySQL to PostgreSQL

GaussDB distributed

Incremental

Full

Full+Incremental

From MySQL to GaussDB Distributed (To the cloud)

From MySQL to GaussDB Distributed (self-built - self-built)

GaussDB primary/standby

Incremental

Full

Full+Incremental

From MySQL to GaussDB Primary/Standby (To the cloud)

From MySQL to GaussDB Primary/Standby (self-built - self-built)

GaussDB(DWS)

NOTE:

This service is currently not supported. Use DataArts Studio for data synchronization.

Incremental

Full

Full+Incremental

From MySQL to GaussDB(DWS)

DataArts Studio

RDS for MariaDB

Incremental

Full

Full+Incremental

From MySQL to MariaDB (To the cloud)

RDS for MySQL

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds

Incremental

Full+Incremental

From MySQL to MySQL (Out of the cloud)

Kafka

Incremental

Full+Incremental

From MySQL to Kafka (Out of the cloud)

CSS/ES

Full+Incremental

From MySQL to CSS/ES (Out of the cloud)

  • On-premises Oracle databases
  • Oracle databases on an ECS

Full+Incremental

From MySQL to Oracle

  • On-premises MariaDB databases
  • MariaDB databases on an ECS
  • MariaDB databases on other clouds

Incremental

Full

Full+Incremental

From MySQL to MariaDB (Out of the cloud)

  • On-premises MySQL databases
  • MySQL databases on an ECS

Kafka

Incremental

Full+Incremental

From MySQL to Kafka (self-built - self-built)

CSS/ES

Full+Incremental

From MySQL to CSS/ES (self-built - self-built)

  • On-premises PostgreSQL databases
  • PostgreSQL databases on an ECS
  • PostgreSQL databases on other clouds
  • RDS for PostgreSQL

RDS for PostgreSQL

Incremental

Full

Full+Incremental

From PostgreSQL to PostgreSQL

GaussDB(DWS)

NOTE:

Only whitelisted users can use this function.

Full+Incremental

From PostgreSQL to GaussDB(DWS)

GaussDB primary/standby

Incremental

Full

Full+Incremental

NOTE:

Only whitelisted users can perform the incremental data synchronization.

From PostgreSQL to GaussDB Primary/Standby

GaussDB distributed

Incremental

Full

Full+Incremental

NOTE:

Only whitelisted users can perform the incremental data synchronization.

From PostgreSQL to GaussDB Distributed

  • On-premises PostgreSQL databases
  • PostgreSQL databases on an ECS

Kafka

Incremental

From PostgreSQL to Kafka (self-built - self-built)

RDS for PostgreSQL

  • On-premises PostgreSQL databases
  • PostgreSQL databases on ECSs

Incremental

Full

Full+Incremental

From PostgreSQL to PostgreSQL (Out of the cloud)

Kafka

Incremental

From PostgreSQL to Kafka (Out of the cloud)

DDM

RDS for MySQL

Incremental

Full

Full+Incremental

From DDM to MySQL (To the cloud)

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds

Incremental

Full

Full+Incremental

From DDM to MySQL (Out of the cloud)

DDM

Full+Incremental

From DDM to DDM

GaussDB(DWS)

NOTE:

This service is currently not supported. Use DataArts Studio for data synchronization.

Full+Incremental

From DDM to GaussDB(DWS)

DataArts Studio

  • On-premises Oracle databases
  • Oracle databases on an ECS

Incremental

Full

Full+Incremental

From DDM to Oracle

Kafka

Incremental

From DDM to Kafka

  • On-premises Oracle databases
  • Oracle databases on an ECS

RDS for MySQL

Incremental

Full

Full+Incremental

From Oracle to MySQL

GaussDB(for MySQL)

Full

Full+Incremental

From Oracle to GaussDB(for MySQL)

RDS for PostgreSQL

Full

Full+Incremental

From Oracle to PostgreSQL

GaussDB primary/standby

Incremental

Full

Full+Incremental

From Oracle to GaussDB Primary/Standby (To the cloud)

From Oracle to GaussDB Primary/Standby (self-built - self-built)

GaussDB distributed

Incremental

Full

Full+Incremental

From Oracle to GaussDB Distributed (To the cloud)

From Oracle to GaussDB Distributed (self-built - self-built)

DDM

Full

Full+Incremental

From Oracle to DDM

GaussDB(DWS)

NOTE:

Only whitelisted users can use this function.

Incremental

Full

Full+Incremental

From Oracle to GaussDB(DWS)

Kafka

Incremental

From Oracle to Kafka

GaussDB distributed

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds
  • RDS for MySQL

Full

Incremental

Full+Incremental

From GaussDB Distributed to MySQL (Out of the cloud)

From GaussDB Distributed to MySQL (self-built - self-built)

  • On-premises Oracle databases
  • Oracle databases on an ECS

Full

Incremental

Full+Incremental

From GaussDB Distributed to Oracle (Out of the cloud)

From GaussDB Distributed to Oracle (self-built - self-built)

GaussDB(DWS)

NOTE:

Only whitelisted users can use this function.

Full

Incremental

Full+Incremental

From GaussDB Distributed to GaussDB(DWS)

Kafka

Incremental

From GaussDB Distributed to Kafka (Out of the cloud)

From GaussDB Distributed to Kafka (self-built - self-built)

GaussDB distributed

Full

Incremental

Full+Incremental

From GaussDB Distributed to GaussDB Distributed

From GaussDB Distributed to GaussDB Distributed (self-built - self-built)

GaussDB primary/standby

Full

Incremental

Full+Incremental

From GaussDB Distributed to GaussDB Primary/Standby (Out of the cloud)

From GaussDB Distributed to GaussDB Primary/Standby (self-built - self-built)

GaussDB primary/standby

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds
  • RDS for MySQL

Full

Incremental

Full+Incremental

From GaussDB Primary/Standby to MySQL (Out of the cloud)

From GaussDB Primary/Standby to MySQL (self-built - self-built)

  • On-premises Oracle databases
  • Oracle databases on an ECS

Full

Incremental

Full+Incremental

From GaussDB Primary/Standby to Oracle (Out of the cloud)

From GaussDB Primary/Standby to Oracle (self-built - self-built)

Kafka

Incremental

From GaussDB Primary/Standby to Kafka (Out of the cloud)

From GaussDB Primary/Standby to Kafka (self-built - self-built)

GaussDB(DWS)

NOTE:

Only whitelisted users can use this function.

Full

Incremental

Full+Incremental

From GaussDB Primary/Standby to GaussDB(DWS)

GaussDB distributed

Full

Incremental

Full+Incremental

From GaussDB Primary/Standby to GaussDB Distributed (Out of the cloud)

From GaussDB Primary/Standby to GaussDB Distributed (self-built - self-built)

GaussDB primary/standby

Full

Incremental

Full+Incremental

From GaussDB Primary/Standby to GaussDB Primary/Standby

From GaussDB Primary/Standby to GaussDB Primary/Standby (self-built - self-built)

GaussDB(for MySQL)

GaussDB(for MySQL)

Incremental

Full+Incremental

From GaussDB(for MySQL) to GaussDB(for MySQL)

  • On-premises MySQL databases
  • MySQL databases on an ECS
  • MySQL databases on other clouds
  • RDS for MySQL

Incremental

Full+Incremental

From GaussDB(for MySQL) to MySQL

GaussDB(DWS)

NOTE:

This service is currently not supported. Use DataArts Studio for data synchronization.

Full+Incremental

From GaussDB(for MySQL) to GaussDB(DWS)

DataArts Studio

Kafka

Incremental

Full+Incremental

From GaussDB(for MySQL) to Kafka

CSS/ES

Full+Incremental

From GaussDB(for MySQL) to CSS/ES

  • On-premises Oracle databases
  • Oracle databases on an ECS

Full+Incremental

From GaussDB(for MySQL) to Oracle

DDS

  • Self-built MongoDB
  • MongoDB on other clouds

Incremental synchronization supports the following modes:

Replica set -> Replica set

Cluster -> Cluster (the source cluster version must be 4.0 or later)

From DDS to MongoDB

Kafka

Incremental

From DDS to Kafka

DB2 for LUW

GaussDB distributed

Full

Full+Incremental

From DB2 for LUW to GaussDB Primary/Standby (To the cloud)

From DB2 for LUW to GaussDB Primary/Standby (self-built - self-built)

GaussDB primary/standby

Full

Full+Incremental

From DB2 for LUW to GaussDB Distributed (To the cloud)

From DB2 for LUW to GaussDB Distributed

(self-built - self-built)

TiDB

GaussDB(for MySQL)

Full+Incremental

From TiDB to GaussDB(for MySQL)

  • On-premises Microsoft SQL Server databases
  • ECS-hosted Microsoft SQL Server databases
  • Microsoft SQL Server-compatible databases on other clouds
  • RDS for SQL Server

GaussDB(DWS)

NOTE:

Only whitelisted users can use this function.

Full+Incremental

From Microsoft SQL Server to GaussDB(DWS)

GaussDB primary/standby

Incremental

Full

Full+Incremental

From Microsoft SQL Server to GaussDB Primary/Standby

GaussDB distributed

Incremental

Full

Full+Incremental

From Microsoft SQL Server to GaussDB Distributed

Microsoft SQL Server

Full+Incremental

From Microsoft SQL Server to Microsoft SQL Server

RDS for MySQL

NOTE:

Only whitelisted users can use this function.

Incremental

Full

Full+Incremental

From Microsoft SQL Server to MySQL

GaussDB(for MySQL)

NOTE:

Only whitelisted users can use this function.

Incremental

Full

Full+Incremental

From Microsoft SQL Server to GaussDB(for MySQL)

PostgreSQL

NOTE:

Only whitelisted users can use this function.

Incremental

Full

Full+Incremental

From Microsoft SQL Server to PostgreSQL

RDS for SQL Server

Kafka

NOTE:

Only whitelisted users can use this function.

Incremental

From Microsoft SQL Server to Kafka (Out of the cloud)

  • On-premises Microsoft SQL Server databases
  • ECS-hosted Microsoft SQL Server databases
  • Microsoft SQL Server-compatible databases on other clouds

Kafka

NOTE:

Only whitelisted users can use this function.

Incremental

From Microsoft SQL Server to Kafka (self-built - self-built)

  • On-premises MongoDB databases
  • MongoDB databases on an ECS
  • MongoDB database on other clouds
  • DDS

DDS

Full+Incremental synchronization supports the following scenarios:

Replica set -> Replica set

From MongoDB to DDS

  • On-premises MariaDB databases
  • MariaDB databases on an ECS
  • MariaDB databases on other clouds

RDS for MariaDB

Full+Incremental

From MariaDB to MariaDB

  • On-premises MariaDB databases
  • MariaDB databases on an ECS
  • MariaDB databases on other clouds

RDS for MySQL

Incremental

Full+Incremental

From MariaDB to MySQL

GaussDB(for MySQL)

Incremental

Full+Incremental

From MariaDB to GaussDB(for MySQL)

RDS for MariaDB

  • On-premises MariaDB databases
  • MariaDB databases on an ECS
  • MariaDB databases on other clouds

Full+Incremental

From MariaDB to MariaDB

Cassandra

GeminiDB Cassandra

Full

From Cassandra to GeminiDB Cassandra

DynamoDB on other clouds (web services)

GeminiDB Dynamo

NOTE:

Only whitelisted users can use this function.

Full

Full+Incremental

From Dynamo to GeminiDB Dynamo

  • On-premises official open-source single-node or master/standby Redis
  • ECS-hosted official open-source single-node or master/standby Redis

GeminiDB Redis

NOTE:

Only whitelisted users can use this function.

Full

Full+Incremental

From Redis to GeminiDB Redis

  • On-premises open-source Redis Cluster
  • ECS-hosted open-source Redis Cluster

GeminiDB Redis

NOTE:

Only whitelisted users can use this function.

Full+Incremental

From Redis Cluster to GeminiDB Redis

GeminiDB Redis

  • On-premises open-source Codis
  • ECS-hosted open-source Codis
  • On-premises single-node or master/standby Redis
  • ECS-hosted single-node or master/standby Redis
  • GeminiDB Redis
NOTE:

Only whitelisted users can use this function.

Full+Incremental

From GeminiDB Redis to Redis

  • On-premises Redis Cluster
  • ECS-hosted Redis Cluster
    NOTE:

    Only whitelisted users can use this function.

Full+Incremental

From GeminiDB Redis to Redis Cluster

Other Cloud Synchronization Solutions

DRS allows you to synchronize data from other cloud databases (such as AWS RDS for MySQL and Aurora for MySQL) to Huawei Cloud databases (such as RDS for MySQL).

Table 2 Synchronization solutions

Source Database Cloud Vendor

Source Database Type

Destination Database (Huawei Cloud)

Solution

AWS

RDS for MySQL

RDS for MySQL

From MySQL to MySQL

AWS

RDS for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

AWS

Aurora for MySQL

RDS for MySQL

From MySQL to MySQL

AWS

Aurora for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

AWS

RDS for MariaDB

RDS for MariaDB

From MariaDB to MariaDB

AWS

RDS for PostgreSQL

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

AWS

Aurora for PostgreSQL (Non-serverless)

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

AWS

RDS for Oracle

GaussDB Primary/Standby

From Oracle to GaussDB Primary/Standby

AWS

RDS for Oracle

GaussDB Distributed

From Oracle to GaussDB Distributed

AWS

RDS for SQL Server

RDS for SQL Server

From Microsoft SQL Server to Microsoft SQL Server

AWS

RDS for SQL Server

GaussDB Primary/Standby

5.3.31-From Microsoft SQL Server to GaussDB Primary/Standby

AWS

RDS for SQL Server

GaussDB Distributed

5.3.32-From Microsoft SQL Server to GaussDB Distributed

Azure

Database for MySQL

RDS for MySQL

From MySQL to MySQL

Azure

Database for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Azure

Database for MariaDB

RDS for MariaDB

From MariaDB to MariaDB

Azure

Database for PostgreSQL

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

Azure

SQL Server on Azure Virtual Machines

RDS for SQL Server

From Microsoft SQL Server to Microsoft SQL Server

Azure

Azure SQL Database(DB)

RDS for SQL Server

From Microsoft SQL Server to Microsoft SQL Server

Azure

Azure SQL Managed Insatnce(MI)

RDS for SQL Server

From Microsoft SQL Server to Microsoft SQL Server

Azure

SQL Server on Azure Virtual Machines

GaussDB Primary/Standby

5.3.31-From Microsoft SQL Server to GaussDB Primary/Standby

Azure

Azure SQL Database(DB)

GaussDB Primary/Standby

5.3.31-From Microsoft SQL Server to GaussDB Primary/Standby

Azure

Azure SQL Managed Insatnce(MI)

GaussDB Primary/Standby

5.3.31-From Microsoft SQL Server to GaussDB Primary/Standby

Azure

SQL Server on Azure Virtual Machines

GaussDB Distributed

5.3.32-From Microsoft SQL Server to GaussDB Distributed

Azure

Azure SQL Database(DB)

GaussDB Distributed

5.3.32-From Microsoft SQL Server to GaussDB Distributed

Azure

Azure SQL Managed Insatnce(MI)

GaussDB Distributed

5.3.32-From Microsoft SQL Server to GaussDB Distributed

Google

Cloud SQL for MySQL

RDS for MySQL

From MySQL to MySQL

Google

Cloud SQL for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Google

Cloud SQL for PostgreSQL

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

Alibaba Cloud

ApsaraDB RDS for MySQL

RDS for MySQL

From MySQL to MySQL

Alibaba Cloud

ApsaraDB RDS for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Alibaba Cloud

PolarDB for MySQL

RDS for MySQL

From MySQL to MySQL

Alibaba Cloud

PolarDB for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Alibaba Cloud

ApsaraDB RDS for MariaDB

RDS for MariaDB

From MariaDB to MariaDB

Alibaba Cloud

ApsaraDB RDS for PostgreSQL

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

Alibaba Cloud

PolarDB for PostgreSQL Standard Edition and Enterprise Edition

RDS for PostgreSQL

From PostgreSQL to PostgreSQL

Tencent Cloud

TencentDB for MySQL

RDS for MySQL

From MySQL to MySQL

Tencent Cloud

TencentDB for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Tencent Cloud

TDSQL-C for MySQL

RDS for MySQL

From MySQL to MySQL

Tencent Cloud

TDSQL-C for MySQL

GaussDB(for MySQL)

From MySQL to GaussDB(for MySQL)

Tencent Cloud

TencentDB for PostgreSQL

RDS for PostgreSQL

From PostgreSQL to PostgreSQL