Migrating Through the CDM Service

Overview

Cloud Data Migration (CDM) provides batch data migration services between homogeneous and heterogeneous data sources. By creating scheduled jobs, CDM connects data sources, such as file systems, databases, and object storage on the on-premises storage servers, to HUAWEI CLOUD OBS. In this way, local data can be migrated to OBS periodically and automatically.

Figure 1 CDM workflow
  1. Creating an OBS bucket

    Create a bucket on OBS Console or OBS Browser+ for storing data.

  2. Purchasing CDM

    Purchase the CDM service, that is, create a CDM cluster to manage connections and jobs.

  3. Configuring connections and jobs

    Create a source connection and a destination connection in the created CDM cluster to respectively connect to the local data source and OBS in the cloud. Then create a CDM job to migrate local data to OBS.

  4. Starting data transmission

    Run the CDM job to start data transmission. You can view the job progress on the job management page.

Example: Periodically Backing Up Files from an FTP Server to OBS

CDM can periodically upload new files to OBS. You do not need to compile code or manually upload the files. You can also use the massive storage capabilities of OBS on HUAWEI CLOUD to back up files. For details about how to periodically back up files from an FTP server to OBS, see From FTP/SFTP to OBS.

Example: Migrating the Consulting Service Data for the Financial Big Data Industry

Consulting company H uses CDM to import local trade statistics to OBS, and uses Data Lake Insight (DLI) to conduct trade statistics analysis. In this way, company H builds its big data analytics platform at an extremely low cost, allowing the company more time to focus on their businesses and make innovations continuously.

For details, see Consulting Service Data Migration in Financial Industry.