Help Center/ DataArts Studio/ User Guide/ DataArts Migration (Offline Jobs)/ Supported Data Sources/ Redis
Updated on 2026-05-20 GMT+08:00
View PDF
Share

Redis

Redis is an open-source, high-performance in-memory data structure store used as a database, cache, and message broker.

DataArts Migration supports the mainstream versions of open-source Redis and Huawei Cloud MRS Redis, and provides efficient and easy-to-use data migration capabilities.

Preparation and Constraints

  • Network requirements

    The Redis data source can communicate with CDM. This ensures smooth data transmission. For details, see Enabling Network Connectivity.

  • Enabling ports

    Redis port (16379): TCP 16379 and the listening ports of the replica set or sharded cluster must be enabled so that DataArts Migration can access Redis.

Supported Data Types

The following table lists the value types supported by Redis.

Value Storage Type

Read

Write

String

√

√

Hash

√

√

List

x

√

Set

x

√

Zset

x

√

Supported Migration Scenarios

DataArts Migration supports the following modes for synchronizing on-premises data:

  • Single table synchronization

    DataArts Migration supports table/file synchronization in data ingestion into a data lake or data migration to the cloud.

  • Database and table shard synchronization

    DataArts Migration supports synchronization of data from multiple databases and tables in data ingestion into a data lake or data migration to the cloud.

  • Entire DB migration

    DataArts Migrations supports synchronization of data from an on-premises database in data ingestion into a data lake or data migration to the cloud.

Database and table shard synchronization and entire DB migration are not supported in all regions. The following table lists the supported Redis migration scenarios.

Supported Migration Scenario

Single Table Read

Single Table Write

Database/Table Shard Read

Database/Table Shard Write

Entire DB Read

Entire DB Write

Supported

√

√

x

√

x

x

Core Capabilities

  • Connection configuration

    Configuration Item

    Supported

    Description

    Support for Secure Shell (SSL)

    x

    SSL encryption ensures secure data transmission. Currently, this function is not supported.
  • Read capabilities

    Configuration Item

    Supported

    Description

    Custom fields

    √

    You can add computed columns, constant columns, or masking functions for tasks to meet personalized service requirements.

    Dirty data processing

    √

    Abnormal data can be written to the dirty data bucket to prevent job failures caused by a small amount of abnormal data.
  • Write capabilities

    Configuration Item

    Supported

    Description

    Conflict resolution

    √

    Duplicate keys can be deleted during writing to handle data conflicts.

    Concurrent write

    √

    Concurrent write improves efficiency.

    Dirty data processing

    √

    Abnormal data can be written to the dirty data bucket to prevent job failures caused by a small amount of abnormal data.

Creating a Data Source

Create a data source in Management Center. For details, see Configuring Data Connection Parameters.

Creating an Offline Data Migration Job

Create a Redis migration job in DataArts Factory. For details, see Creating an Offline Processing Migration Job.

Parent topic: Supported Data Sources