Migrating Data Using Direct Connect (rsync)

Solution Overview

You can migrate data from a local NAS to SFS Turbo using rsync over Direct Connect.

In this solution, a Linux ECS is created to connect the local NAS and SFS Turbo, and data is migrated to the cloud using this ECS.

You can also refer to this solution to migrate data from an on-cloud NAS to SFS Turbo using the Internet. Ensure that the on-cloud NAS and SFS Turbo belong to the same VPC.

Notes and Constraints

• Special files, such as devices and linked files, can be migrated.
• Resumable data transfer is supported.
• Properties, such as permissions, time, soft and hard links, owner, and group, of the original files and directories can be retained after data migration.
• The rcp, rsh, and ssh tools are supported during file transfer.
• Incremental migration is supported, so you can only migrate the changed data.
• If there are multi-level directories or massive small files, you are recommended to use a multi-process script or rclone. This is because rsync has low efficiency in these scenarios.

Prerequisites

• You have purchased and configured Direct Connect. For details, see Direct Connect User Guide.
• You have created a Linux ECS.
• You have created an SFS Turbo file system and have obtained the shared path of the file system.
• You have obtained the shared path of the local NAS.
• A trust relationship has been established between the local NAS and the ECS.

Resource Planning

Table 1 describes the resource planning in this solution.

Procedure

1. Log in to the Linux ECS.
2. Mount the local NAS to the ECS.

   mount -t nfs -o vers=3,timeo=600,noresvport,nolock,tcp Shared path of the local NAS /mnt/src

3. Mount the SFS Turbo file system to the ECS.

   mount -t nfs -o vers=3,timeo=600,noresvport,nolock,tcp Shared path of the file system /mnt/dst

4. Install rsync on the Linux ECS.

   yum install rsync 
   Figure 1 Installing rsync
   
   NOTE:

   Ensure that rsync is installed on both the source and destination servers. Or, an error will be reported.

5. Check the installation result and version of rsync.

   rsync -version
   Figure 2 Checking the installation result
   

6. Migrate data in the /mnt/src directory on the source server to the /mnt/dst directory (file system) on the destination server.

   rsync -avP /mnt/src /mnt/dst
   Figure 3 Data synchronization
   

Verification

1. Log in to the Linux ECS.
2. Check the file synchronization results on the destination server.

   cd /mnt/dst
   ls | wc -l

3. If the data volume is the same as that on the source server, data is migrated successfully.