What Are the Restrictions on Using MgC for Storage Migration?

Objects with multiple versions

By default, only the latest version of objects in source buckets is migrated.

Storage class of target buckets

The storage class of target buckets can only be Standard or Infrequent Access. You can change the storage class of target buckets after the migration is complete.

Migration object

• Object names must not contain special characters.
• A single object cannot be larger than 4.76837158203125 TB (500 MB x 10,000). Otherwise, the migration may fail.

Migration network

Migrations are supported over public networks, private networks, and private lines.

Symbolic links

• Symbolic links cannot be used for specifying migration paths which define the migration scope. If the migration path you specify is pointed to by a symbolic link, you need to:
  • Enter the actual path when creating a migration workflow.
  • After the migration is complete, manually create a symbolic link to the path at the target.
• Migration of symbolic links is not supported for migration from NAS_SMB or migration from NAS_NFS to OBS.
• For migration from NAS_NFS or Alibaba Cloud OSS to NAS_NFS, symbolic links can be migrated. To keep symbolic links valid after being migrated, enable metadata migration. Otherwise, the symbolic links will lose their link functionality and become regular files after the migration.
  NOTICE:

  If the objects that soft links point to are not completely migrated to the target, these soft link files may fail the verification. As a result, the task will be in a failed status. In this case, wait until the involved objects are completely migrated to the target, and try the task again.

Migration scope

You can migrate a single bucket or multiple buckets in batches.

Metadata migration

• Only Chinese characters, English characters, digits, and hyphens (-) can be migrated. Other characters cannot be migrated.
  • Chinese characters are URL encoded during the migration.
    CAUTION:

    Chinese punctuation marks cannot be URL encoded during the migration. If metadata contains Chinese punctuation marks, the correponding object will fail to be migrated.

  • English characters, digits, and hyphens (-) are directly migrated without code conversion.
• For heterogeneous migrations, metadata cannot be migrated.

Archived data

To migrate archived data from object storage, you must restore it first. You need to:

• Create migration workflows after the restoration is complete.
• Configure a validity period for restored data based on the total amount of data to be migrated. This helps prevent migration failures because restored data becomes archived again during the migration.
• Pay your source cloud vendor for restoring archived data. To learn about the pricing details, contact your source cloud vendor.

Concurrent subtasks

You can define the number of concurrent subtasks based on the number of online migration nodes. There cannot be more than 10 concurrent subtasks for each online migration node.

For example, if there are 2 online migration nodes, the maximum number of subtasks can be 20 or any number below.

Object list files

These files must be stored in the same region as the target bucket.

• The files must be in .txt format, and their metadata Content-Type must be text/plain.
• A single file can contain a maximum of 100,000 rows.
• A single file cannot exceed 300 MB.
• A maximum of 10,000 list files can be stored in the folder.
• The files must be in UTF-8 without BOM.
• The length of each line in a file cannot exceed 65,535 characters, or the migration will fail.
• The Content-Encoding metadata of the files must be left empty, or the migration will fail.
• In the files, a tab character (\t) must be used to separate the URL and new file name in each line. The format is [URL][Tab character][New file name]. Only the Chinese and special characters in the names must be URL encoded.
• Spaces are not allowed in each line in a file. Spaces may cause migration failures because they may be mistakenly identified as object names.

Migration source: SMB systems

• File systems where a single directory contains more than 5 million files cannot be migrated.
• Resumable transfer is not supported.
• Soft links cannot be migrated.

Migration source: NAS file systems

• The following types of files can be migrated: regular files, directory files, symbolic link files, and hard link files.
  CAUTION:

  If the file handle is occupied or the source file is deleted, the file will fail to be migrated.

• Special files such as character device files, block device files, sockets, and pipe files cannot be migrated.
• The metadata of symbolic link files cannot be migrated.