Help Center/ Scalable File Service Turbo/ Best Practices/ Migrating Data to SFS Turbo/ Migrating Data Using Direct Connect (rsync)
Updated on 2024-11-05 GMT+08:00
View PDF

Migrating Data Using Direct Connect (rsync)

Solution Overview

You can migrate data from a local NAS to SFS Turbo using rsync over Direct Connect.

In this solution, a Linux ECS is created to connect the local NAS and SFS Turbo, and data is migrated to the cloud using this ECS.

You can also refer to this solution to migrate data from an on-cloud NAS to SFS Turbo using the Internet. Ensure that the on-cloud NAS and SFS Turbo belong to the same VPC.

Notes and Constraints

  • Special files, such as devices and linked files, can be migrated.
  • Resumable data transfer is supported.
  • Properties, such as permissions, time, soft and hard links, owner, and group, of the original files and directories can be retained after data migration.
  • The rcp, rsh, and ssh tools are supported during file transfer.
  • Incremental migration is supported, so you can only migrate the changed data.
  • If there are multi-level directories or massive small files, you are recommended to use a multi-process script or rclone. This is because rsync has low efficiency in these scenarios.

Prerequisites

  • You have purchased and configured Direct Connect. For details, see Direct Connect User Guide.
  • You have created a Linux ECS.
  • You have created an SFS Turbo file system and have obtained the shared path of the file system.
  • You have obtained the shared path of the local NAS.
  • A trust relationship has been established between the local NAS and the ECS.

Resource Planning

Table 1 describes the resource planning in this solution.

Table 1 Resource planning

Resource

Example Configuration

Description

ECS

Specifications: 8 vCPUs | 16 GB | c7.2xlarge.2

OS: Linux

Region: EU-Dublin

VPC: VPC1

Ensure that the /mnt/src and /mnt/dst directories have been created.

Procedure

  1. Log in to the Linux ECS.
  2. Mount the local NAS to the ECS. 

    mount -t nfs -o vers=3,timeo=600,noresvport,nolock,tcp Shared path of the local NAS /mnt/src

  3. Mount the SFS Turbo file system to the ECS. 

    mount -t nfs -o vers=3,timeo=600,noresvport,nolock,tcp Shared path of the file system /mnt/dst

  4. Install rsync on the Linux ECS. 

    yum install rsync
    Figure 1 Installing rsync

    Ensure that rsync is installed on both the source and destination servers. Or, an error will be reported.

  5. Check the installation result and version of rsync. 

    rsync -version
    Figure 2 Checking the installation result

  6. Migrate data in the /mnt/src directory on the source server to the /mnt/dst directory (file system) on the destination server. 

    rsync -avP /mnt/src /mnt/dst
    Figure 3 Data synchronization

Verification

  1. Log in to the Linux ECS.
  2. Check the file synchronization results on the destination server. 

    cd /mnt/dst
ls | wc -l

  3. If the data volume is the same as that on the source server, data is migrated successfully.