GBase

Preparation and Constraints

• Network requirements

  The GBase data source can communicate with CDM. This ensures smooth data transmission. For details, see Enabling Network Connectivity.

• Required permissions
  • Reading data from GBase: The account must have the read-only permission (SELECT) on the table to be synchronized so that data can be read securely and accurately.
  • Writing data to GBase: The account must have the write permission (INSERT, DELETE, UPDATE, and CREATE) on the table to be synchronized so that data can be correctly written to the destination table.

Driver Selection

Supported Data Types

Supported Migration Scenarios

DataArts Migration supports the following modes for synchronizing on-premises data:

• Single table synchronization

  DataArts Migration supports table/file synchronization in data ingestion into a data lake or data migration to the cloud.

• Database and table shard synchronization

  DataArts Migration supports synchronization of data from multiple databases and tables in data ingestion into a data lake or data migration to the cloud.

• Entire DB migration

  DataArts Migrations supports synchronization of data from an on-premises database in data ingestion into a data lake or data migration to the cloud.

Database and table shard synchronization and entire DB migration are not supported in all regions. The following table lists the supported GBase data migration scenarios.

Core Capabilities

• Connection configuration

  Configuration Item	Supported	Description
  User/AK	√	User authentication ensures connection security.
  SSL encryption authentication	x	SSL encryption ensures secure data transmission. Currently, this function is not supported.
  Connection configuration optimization	√	Connection configuration such as connectTimeout can be optimized to improve connection performance.
  Custom driver	√	Custom drivers are supported and provide better flexibility.

• Read capabilities

  Configuration Item	Supported	Description
  Incremental read	√	Where conditions and the SQL mode enable incremental data reading.
  Shard concurrency	√	Horizontal sharding based on primary keys or common fields and multi-thread concurrent extraction significantly improve the throughput and efficiency.
  Dirty data processing	√	Abnormal data can be written to the dirty data bucket to prevent job failures caused by a small amount of abnormal data.
  Custom fields	√	You can add computed columns, constant columns, or masking functions for tasks to meet personalized service requirements.

• Write capabilities

  Configuration Item	Supported	Description
  Dirty data processing	√	Abnormal data can be written to the dirty data bucket to prevent job failures caused by a small amount of abnormal data.
  Pre- and post-import processing	√	Operations such as preSql and delete can clean and process data before and after data import.
  Concurrent write	√	Concurrent write improves efficiency.
  Optimization of the number of written rows	√	You can improve write performance by adjusting the values of parameters Commit Size and Batch Size in the connection configuration.

Creating a Data Source

Create a data source in Management Center. For details, see Configuring Data Connection Parameters.

Creating an Offline Data Migration Job

Create a GBase migration job in DataArts Factory. For details, see Creating an Offline Processing Migration Job.