Migrating Data Between a General-Purpose File System and an SFS Turbo File System
Solution Overview
You can migrate data from an SFS general-purpose file system to an SFS Turbo file system or the other way around.
This solution creates a Linux ECS to connect a general-purpose file system with an SFS Turbo file system.
Constraints
- This solution is only applicable for the data migration of Linux ECSs.
- The Linux ECS, general-purpose file system, and SFS Turbo file system must be in the same VPC.
- Incremental migration is supported, so you can only migrate the changed data.
Prerequisites
- You have created a Linux ECS.
- You have created a general-purpose file system and an SFS Turbo file system and have obtained their addresses.
Resource Planning
Table 1 describes the resource planning in this solution.
Procedure
- Log in to the ECS console.
- Log in to the Linux ECS.
- Mount file system 1 (either the general-purpose or SFS Turbo file system). After that, you can access file system 1 on the Linux ECS.
mount -t nfs -o vers=3,timeo=600,noresvport,nolock <address-of-file-system-1> /mnt/src
- Mount file system 2 (the other file system that is not mounted in the previous step). After that, you can access file system 2 on the Linux ECS.
mount -t nfs -o vers=3,timeo=600,noresvport,nolock <address-of-file-system-2> /mnt/dst
- Download and install rclone. For the download address, see https://rclone.org/downloads/.
- Synchronize data.
rclone copy /mnt/src /mnt/dst -P --transfers 32 --checkers 64 --links --create-empty-src-dirs
The following describes the parameters. Set transfers and checkers based on the system specifications.
- /mnt/src: source path
- /mnt/dst: destination path
- --transfers: number of files that can be transferred concurrently
- --checkers: number of local files that can be scanned concurrently
- -P: data copy progress
- --links: replicates the soft links from the source. They are saved as soft links in the destination.
- --copy-links: replicates the content of files to which the soft links point. They are saved as files rather than soft links in the destination.
- --create-empty-src-dirs: replicates the empty directories from the source to the destination.
After data synchronization is complete, go to the target file system to check whether data is migrated.
Verification
- Log in to the Linux ECS.
- Check the file synchronization results on the destination server.
cd /mnt/dst ls | wc -l
- If the data volume is the same as that on the source server, data is migrated successfully.