Creating a Batch File Storage Migration Plan
Follow this section to configure a migration plan for batch migrating file systems.
The Batch Object Storage Migration template can be used to migrate multiple file systems in a batch. If only one file system needs to be migrated, create a migration workflow directly.
Preparations
- Creating a migration project
Create a migration project on the MgC console. For details, see Managing Migration Projects.
- Creating a migration cluster
Create a dedicated migration cluster for this migration. A cluster consists of a master node and several list and migration nodes. For details about how to create a cluster, see Creating a Migration Cluster.
- Creating target file systems
Create target file systems for receiving migrated source data. For details, see Creating a General Purpose File System or Creating an SFS Turbo File System.
Notes
- Only one migration workflow can be created for a migration plan.
- A maximum of 100 file systems can be added to a migration plan.
- Target file systems included in a migration plan must be in the same region.
Procedure
- Sign in to the MgC console.
- In the navigation pane, choose Design > Migration Plans.
- Click Create Migration Plan in the upper right corner of the page.
- In the Batch File Storage Migration card, click Configure Migration Plan.
- In the Basic Settings area, set parameters listed in Table 1.
- Click Add. A new row will be added below, allowing you to configure a source file system. Each click of this button will add another row, enabling you to include multiple source file systems in this plan.
Figure 1 Adding a source file system
- Configure a source file system based on Table 2.
Table 2 Parameters for configuring a source file system Parameter
Description
Remarks
Storage Type
Supported source storage types include NAS_GFS, NAS_NFS_V3_PROTOCOL, and NAS_NFS_V3_MOUNT.
-
Migration Method
Select a migration method.
- Full migration: This method is used to migrate all data in a specific path in the source file system.
- List migration: This method is used to migrate files and directories recorded in lists.
-
List Path
If the list migration method is used, enter the path to the list files. If the full migration method is used, leave it blank.
A list file must meet the following requirements:
- A list file cannot exceed 30 MB.
- A list file must be a .txt file.
- A list file must be in UTF-8 without BOM.
- Each line in a list file can contain only one file or directory name, and the name must be URL encoded.
- Each line in a list file cannot exceed 16,384 (16 × 1,024) bytes, or the migration will fail.
- A list file can contain a maximum of 10,000 lines.
File System Address
Enter the mount address of the source file system.
- If the storage type is NAS_GFS, the file system address can include a host name, domain name, (optional) subdomain, port, and path.
- If the storage type is NAS_NFS_V3_PROTOCOL or NAS_NFS_V3_MOUNT, the file system address must match any of the following formats:
- <IP-address>:/
- <IP-address>:/<path>
- <domain-name>:/
- <domain-name>:/<path>
For a full migration, the combination of a source file system address and the path to be migrated must be unique. For a list migration, the combination of a source file system address and the list path must be unique. In both cases, the prefix matching rule is applied.
For example, if you have added the file system address 192.168.0.1:/a with a migration path /abc/a, an error will be reported if you add the file system address 192.168.0.1:/a with a migration path /abc. To overwrite an existing path, you need to delete the existing address and path combination first.
Path
Enter the directory where files and directories to be migrated are located. The format is /Folder name.
If the list migration method is selected, enter / in the Path text box.
- Each time after you configure a source file system, click Save in the Operation column. After all source file systems to be migrated are configured, click Next.
- In the list, click Modify in the Operation column to configure a target files system for each source file system.
Table 3 Parameters for configuring a target file system Parameter
Description
Remarks
Source Path
This path is automatically generated by combining the source file system address with the path to be migrated.
-
Storage Type
Only NAS_NFS_V3_MOUNT is supported.
File System Address
- If a General Purpose file system is used as the target, enter the mount address of the file system. To obtain the mount address, go to the file system list and click the icon next to the address in the Mount Point column.
- If an SFS Turbo file system is used as the target, enter the shared path of the file system. To obtain the shared path, go to the SFS Turbo file system list, click next to the path in Shared Path column.
Combinations of target file system addresses and paths can be duplicated.
Path
Enter the directory for storing files and directories migrated. The format is /Folder name.
-
- Each time after you configure a target file system, click Save in the Operation column. After you configure a target file system for each source file system, click Next. You can assess how large of a migration cluster is required for the migration and then create a migration cluster with the recommended specifications. Alternatively, you can skip this step and use an existing migration cluster. For details about how to create a cluster, see Creating a Migration Cluster.
- Click Next to select an existing migration cluster. All resources in this plan will be migrated using this cluster.
- Click Select Cluster. The Select Cluster page is displayed on the right.
- In the cluster list, select the cluster to be used and click OK. The cluster must be in a healthy state. If you want to modify an existing cluster to meet your requirements, see Managing a Migration Cluster.
Figure 2 Selecting a migration cluster
- Click OK. After migration plan is created, you can see it in the list.
- If you need to modify the plan settings, click Design in the Operation column.
- After Completed appears in the Progress column, click Create Workflow in the Operation column to create a migration workflow to migrate all source file systems in the plan in a batch.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot