| Data warehouse | GaussDB(DWS) | - Data warehouse: GaussDB(DWS), Data Lake Insight (DLI), Doris, and MRS ClickHouse
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, RDS for SQL Server, MySQL, PostgreSQL, Microsoft SQL Server, and Oracle
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| The DWS physical machine management mode is not supported. |
| Data Lake Insight (DLI) | - Data warehouse: GaussDB(DWS), Data Lake Insight (DLI), Doris, and MRS ClickHouse
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, RDS for SQL Server, MySQL, PostgreSQL, Microsoft SQL Server, and Oracle
- NoSQL: MongoDB
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| Recommended MongoDB version: 4.2 You must have the SELECT permission (for querying tables) on all fields of the DLI data source. |
| MRS ClickHouse | Data warehouse: MRS ClickHouse and Data Lake Insight (DLI) | - Recommended MRS ClickHouse version: 21.3.4.X
-
MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported. |
| Doris | Data warehouses: Doris | MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported. |
| Hadoop | MRS HDFS | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, RDS for SQL Server, MySQL, PostgreSQL, Microsoft SQL Server, and Oracle
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| - Supported by local storage. Only MRS Hive and MRS Hudi are supported in storage-compute decoupling scenarios.
- Only MRS Hive is supported in Ranger scenarios.
- Not supported if SSL is enabled for ZooKeeper
- Recommended MRS HDFS versions:
- Recommended MRS HBase versions:
- MRS Hive and MRS Hudi 2.x versions are not supported. The following versions are recommended:
-
MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported. |
| MRS HBase |
| MRS Hive | - Data warehouse: GaussDB(DWS), Data Lake Insight (DLI), Doris, and MRS ClickHouse
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, RDS for SQL Server, MySQL, PostgreSQL, Microsoft SQL Server, and Oracle
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS), CloudTable, and SAP HANA
|
| MRS Hudi | - Data warehouse: GaussDB(DWS)
- Hadoop: MRS HBase
|
| Apache HBase | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| - Apache cannot serve as the destination.
- Supported only by local storage and not in storage-compute decoupling scenarios
- Not supported by Ranger
- Not supported if SSL is enabled for ZooKeeper
- Recommended Apache HBase versions:
- Apache Hive 2.x versions are not supported. The following versions are recommended:
- Recommended Apache HDFS versions:
|
| Apache Hive |
| Apache HDFS |
| Object storage | Object Storage Service (OBS) | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| - Object Storage Migration Service (OMS) is recommended for migration between object storage services.
- Binary files cannot be imported to a database or NoSQL.
|
| File system | FTP | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Search: Elasticsearch
- Object storage: Object Storage Service (OBS)
- In OBT: Cloud Search Service (CSS) and CloudTable
| - The file system cannot serve as the destination.
- Only text files such as CSV files can be migrated from FTP or SFTP servers to search services. Binary files cannot.
- Only binary files can be migrated from FTP or SFTP servers to OBS.
- obsutil is recommended for migrating data from HTTP servers to OBS.
|
| SFTP |
| HTTP | Hadoop: MRS HDFS |
| Relational database | RDS for MySQL | - Data warehouse: GaussDB(DWS), Data Lake Insight (DLI), and Doris
- Hadoop: MRS HDFS, MRS HBase, MRS Hive, and MRS Hudi
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, and RDS for SQL Server
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS), CloudTable, and SAP HANA
| - You are advised to use Data Replication Service (DRS) to migrate data between OLTP databases.
- Recommended Microsoft SQL Server version: 2005 or later
- Greenplum, Kingbase, and GaussDB can be connected using the PostgreSQL connector. The supported source and destination are the same as those of the PostgreSQL data source.
|
| RDS for SQL Server | - Data warehouse: GaussDB(DWS)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, and RDS for SQL Server
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
|
| RDS for PostgreSQL |
| MySQL | - Data warehouse: GaussDB(DWS)
- Hadoop: MRS HDFS, MRS HBase, MRS Hive, and MRS Hudi
- Object storage: Object Storage Service (OBS)
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
|
| PostgreSQL |
| Oracle |
| Microsoft SQL Server | - Data warehouse: GaussDB(DWS)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
|
| NoSQL | Distributed Cache Service (DCS) | - Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
| NoSQL cannot serve as the destination. |
| Redis |
| MongoDB |
| Message system | Apache Kafka | In OBT: Cloud Search Service (CSS) | The message system cannot serve as the destination. |
| DMS Kafka |
| MRS Kafka | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, and RDS for SQL Server
- NoSQL: CloudTable
- Search: Elasticsearch and Cloud Search Service (CSS)
| - MRS Kafka cannot serve as the destination.
- Supported only by local storage and not in storage-compute decoupling scenarios
- Not supported by Ranger
- Not supported if SSL is enabled for ZooKeeper
-
MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported. |
| Search | Elasticsearch | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, and RDS for SQL Server
- Search: Elasticsearch
- In OBT: CloudTable and Cloud Search Service (CSS)
| Only the non-security mode is supported. |
| In OBT | CloudTable HBase | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, RDS for SQL Server, MySQL, PostgreSQL, Microsoft SQL Server, and Oracle
- Search: Elasticsearch
- In OBT: CloudTable and Cloud Search Service (CSS)
| - |
| Cloud Search Service (CSS) | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Relational database: RDS for MySQL, RDS for PostgreSQL, and RDS for SQL Server
- Search: Elasticsearch
- In OBT: CloudTable and Cloud Search Service (CSS)
| N/A |
| SAP HANA | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS Hive
| SAP HANA data sources have the following restrictions: - SAP HANA cannot serve as the destination.
- Only the 2.00.050.00.1592305219 version is supported.
- Only the Generic Edition is supported.
- BW/4 FOR HANA is not supported.
- Only database names, table names, and column names consisting of English letters are supported. Special characters such as spaces and symbols are not allowed.
- The following data types are supported: date, digit, Boolean, and character (except SHORTTEXT). Other data types such as binary are not supported.
- During migration, tables cannot be automatically created at the destination.
|
| FusionInsight HDFS | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| - FusionInsight cannot serve as the destination.
- Supported only by local storage and not in storage-compute decoupling scenarios
- Not supported by Ranger
- Not supported if SSL is enabled for ZooKeeper
- Recommended FusionInsight HDFS versions:
- Recommended FusionInsight HBase versions:
- Recommended FusionInsight Hive versions:
|
| FusionInsight HBase |
| FusionInsight Hive |
| Database shard | - Data warehouse shard: Data Lake Insight (DLI)
- Hadoop: MRS HBase and MRS Hive
- Object storage: Object Storage Service (OBS)
- In OBT: Cloud Search Service (CSS)
| Database shards cannot serve as the destination. |
| Dameng database | - Data warehouse: GaussDB(DWS)
- Hadoop: MRS Hive and MRS Hudi
| - |
| ShenTong | Hadoop: MRS Hive and MRS Hudi | - |
| Document Database Service (DDS) | Hadoop: MRS HDFS, MRS HBase, and MRS Hive | - |
| Cassandra | - Data warehouse: GaussDB(DWS) and Data Lake Insight (DLI)
- Hadoop: MRS HDFS, MRS HBase, and MRS Hive
- Object storage: Object Storage Service (OBS)
- Search: Elasticsearch
- In OBT: Cloud Search Service (CSS) and CloudTable
| - |
| GBASE8S | - Hadoop: MRS HDFS and MRS HBase
- Message system: MRS Kafka
| - |
| GBASE8A | - Hadoop: MRS HDFS, MRS Hive, and MRS HBase
- Message system: MRS Kafka
| - |