Data Layer Migration

Use the OMS to view and manage migration tasks, create task groups, assess bucket data, and check audit logs. See the Object Storage Migration Service Documentation for details.

Figure 2 OMS

The Data Express Service (DES) helps you move data to Huawei Cloud. It can handle terabytes or petabytes of data. DES uses physical storage devices like USB drives or eSATA disks, or a tool called Teleport, to transfer large amounts of data quickly. This solves issues with high cloud bandwidth costs and long upload times.

For details, see the Data Express Service Documentation.

Huawei Cloud offers custom migration services for moving storage data. Their expert teams create tailored migration plans and offer complete support. They assist with both full and incremental data moves, ensuring accuracy at each step. This service helps transfer data from local storage to the cloud.

Network Attached Storage (NAS) is a file system for sharing, scaling, and reliable, fast data access.

Scalable File Service (SFS) offers scalable, high-performance file storage over a network. It allows shared file access between multiple Elastic Cloud Servers (ECSs), Bare Metal Servers (BMSs), and containers on Cloud Container Engine (CCE) and Cloud Container Instance (CCI).

If the network is connected during NAS migration, you can mount files to multiple platforms. Use Rclone or Rsync to copy files from the source directory to the SFS or SFS Turbo file system on the transit host.

Figure 3 File migration

Rclone is a CLI tool for synchronizing, uploading, and downloading data between various cloud storage and web disks. It allows users to set up multiple threads and concurrent tasks, which speeds up migrations and reduces time. Rclone also checks and synchronize data, copying files from one system to another for NAS file migration.

Remote synchronize (Rsync) is a Remote Copy Protocol (RCP)-based remote file synchronization tool that uses its own Rsync algorithm.

Figure 4 Rsync migration

Rsync is enabled on each service platform. The Rsync client script is set up on the file server. A scheduled task, like Crontab on Linux, syncs files from the service server to the disk array incrementally (fully the first time). It has the following advantages:

1. Incremental file synchronization is fast, efficient, and uses fewer resources.
2. It supports network access via SSH and RSH.
3. Stopping the Rsync service does not affect other services.
4. It supports mirrored data copies, ideal for distributing static files online with good scalability.

Databases are classified into relational databases and non-relational databases. Relational databases are crucial because they keep data consistent. To move your database to Huawei Cloud, choose one of these methods:

1. Use SMS host migration. If your source is a self-built database on an ECS, migrate the ECS database server to Huawei Cloud's ECS. SMS makes this easy but will pause database services during the process. For minimal downtime, use database backups or synchronization.
2. Use backup and restoration. This method involves saving the source data, stopping the source database, performing a full backup, keeping necessary logs, and restoring the data on the target system.
3. Use Data Replication Service (DRS) for online migration and real-time synchronization. DRS works across cloud platforms, on-premises to cloud, and between regions. It is a reliable, secure, and efficient service that simplifies data flow and reduces transmission costs. It simplifies the data flow between databases, significantly reducing data transmission costs.

   DRS supports various data sources and offers real-time migration, backup migration, real-time synchronization, data subscription, and DR. For details, see the Data Replication Service Documentation.

Figure 5 DRS migration

The following are common best practices for database migration. See DRS Best Practices Summary for more best practices.