Compute
Elastic Cloud Server
Huawei Cloud Flexus
Bare Metal Server
Auto Scaling
Image Management Service
Dedicated Host
FunctionGraph
Cloud Phone Host
Huawei Cloud EulerOS
Networking
Virtual Private Cloud
Elastic IP
Elastic Load Balance
NAT Gateway
Direct Connect
Virtual Private Network
VPC Endpoint
Cloud Connect
Enterprise Router
Enterprise Switch
Global Accelerator
Management & Governance
Cloud Eye
Identity and Access Management
Cloud Trace Service
Resource Formation Service
Tag Management Service
Log Tank Service
Config
OneAccess
Resource Access Manager
Simple Message Notification
Application Performance Management
Application Operations Management
Organizations
Optimization Advisor
IAM Identity Center
Cloud Operations Center
Resource Governance Center
Migration
Server Migration Service
Object Storage Migration Service
Cloud Data Migration
Migration Center
Cloud Ecosystem
KooGallery
Partner Center
User Support
My Account
Billing Center
Cost Center
Resource Center
Enterprise Management
Service Tickets
HUAWEI CLOUD (International) FAQs
ICP Filing
Support Plans
My Credentials
Customer Operation Capabilities
Partner Support Plans
Professional Services
Analytics
MapReduce Service
Data Lake Insight
CloudTable Service
Cloud Search Service
Data Lake Visualization
Data Ingestion Service
GaussDB(DWS)
DataArts Studio
Data Lake Factory
DataArts Lake Formation
IoT
IoT Device Access
Others
Product Pricing Details
System Permissions
Console Quick Start
Common FAQs
Instructions for Associating with a HUAWEI CLOUD Partner
Message Center
Security & Compliance
Security Technologies and Applications
Web Application Firewall
Host Security Service
Cloud Firewall
SecMaster
Anti-DDoS Service
Data Encryption Workshop
Database Security Service
Cloud Bastion Host
Data Security Center
Cloud Certificate Manager
Edge Security
Managed Threat Detection
Blockchain
Blockchain Service
Web3 Node Engine Service
Media Services
Media Processing Center
Video On Demand
Live
SparkRTC
MetaStudio
Storage
Object Storage Service
Elastic Volume Service
Cloud Backup and Recovery
Storage Disaster Recovery Service
Scalable File Service Turbo
Scalable File Service
Volume Backup Service
Cloud Server Backup Service
Data Express Service
Dedicated Distributed Storage Service
Containers
Cloud Container Engine
SoftWare Repository for Container
Application Service Mesh
Ubiquitous Cloud Native Service
Cloud Container Instance
Databases
Relational Database Service
Document Database Service
Data Admin Service
Data Replication Service
GeminiDB
GaussDB
Distributed Database Middleware
Database and Application Migration UGO
TaurusDB
Middleware
Distributed Cache Service
API Gateway
Distributed Message Service for Kafka
Distributed Message Service for RabbitMQ
Distributed Message Service for RocketMQ
Cloud Service Engine
Multi-Site High Availability Service
EventGrid
Dedicated Cloud
Dedicated Computing Cluster
Business Applications
Workspace
ROMA Connect
Message & SMS
Domain Name Service
Edge Data Center Management
Meeting
AI
Face Recognition Service
Graph Engine Service
Content Moderation
Image Recognition
Optical Character Recognition
ModelArts
ImageSearch
Conversational Bot Service
Speech Interaction Service
Huawei HiLens
Video Intelligent Analysis Service
Developer Tools
SDK Developer Guide
API Request Signing Guide
Terraform
Koo Command Line Interface
Content Delivery & Edge Computing
Content Delivery Network
Intelligent EdgeFabric
CloudPond
Intelligent EdgeCloud
Solutions
SAP Cloud
High Performance Computing
Developer Services
ServiceStage
CodeArts
CodeArts PerfTest
CodeArts Req
CodeArts Pipeline
CodeArts Build
CodeArts Deploy
CodeArts Artifact
CodeArts TestPlan
CodeArts Check
CodeArts Repo
Cloud Application Engine
MacroVerse aPaaS
KooMessage
KooPhone
KooDrive
On this page

Show all

Help Center/ Migration Center/ FAQs/ Storage Migration/ What Are the Restrictions on Using MgC for Storage Migration?

What Are the Restrictions on Using MgC for Storage Migration?

Updated on 2025-02-17 GMT+08:00

Table 1 and Table 2 list the constraints on storage migration using MgC.

Table 1 General constraints on storage migration

Item

Constraint

Objects with multiple versions

By default, only the latest version of objects in source buckets is migrated.

Storage class of target buckets

The storage class of target buckets can only be Standard or Infrequent Access. You can change the storage class of target buckets after the migration is complete.

Migration object

  • Object names cannot contain special characters.
  • A single object cannot be larger than 4.76837158203125 TB (500 MB × 10,000). Otherwise, the migration may fail.

Migration network

Migrations are supported over public networks, private networks, and private lines.

Symbolic links

  • Symbolic links cannot be used for specifying migration paths which define the migration scope. If the migration path you specify is pointed to by a symbolic link, you need to:
    • Enter the actual path when specifying the migration path.
    • After the migration is complete, manually create a symbolic link to the path at the target.
  • For migration from NAS_SMB or migration from NAS_NFS to OBS, symbolic links cannot be migrated.
  • For migration from NAS_NFS to NAS_NFS, symbolic links can be migrated by enabling metadata migration. Otherwise, these files will be skipped during the migration.
  • For migration from Alibaba Cloud OSS to NAS_NFS, symbolic links can be migrated by enabling metadata migration. Otherwise, the symbolic links will lose their link functionality and become regular files after the migration.
    NOTICE:

    If the objects that symbolic links point to are not completely migrated to the target, these symbolic link files may fail the verification. As a result, the task will be in a failed status. In this case, wait until the involved objects are completely migrated to the target, and try the task again.

Hard links

For migration from NAS_NFS to NAS_NFS, hard links can be migrated by enabling metadata migration. Otherwise, these files will be skipped during the migration.

Migration scope

You can migrate a single bucket or multiple buckets in batches.

Metadata migration

  • Only Chinese characters, English characters, digits, and hyphens (-) can be migrated. Other characters cannot be migrated.
    • Chinese characters are URL encoded during the migration.
      CAUTION:

      Chinese punctuation marks cannot be URL encoded during the migration. If metadata contains Chinese punctuation marks, the metadata and the corresponding object will fail to be migrated.

    • English characters, digits, and hyphens (-) are directly migrated without being encoded.
  • For heterogeneous migrations, metadata cannot be migrated.

Archived data

To migrate archived data from object storage, you must restore it first. You need to:

  • Ensure the restoration is complete before creating migration workflows.
  • Configure a validity period for restored data based on the total amount of data to be migrated. This helps prevent migration failures because restored data becomes archived again during the migration.
  • Pay your source cloud vendor for restoring archived data. To learn about the pricing details, contact your source cloud vendor.

Concurrent subtasks

You can define the number of concurrent subtasks based on the number of online migration nodes. There cannot be more than 10 concurrent subtasks for each online migration node.

For example, if there are 2 online migration nodes, the maximum number of subtasks can be 20 or any number below.

Object list files

These files must be stored in the same region as the target bucket.

  • These files must be in .txt format, and their metadata Content-Type must be text/plain. The directory where these files are stored cannot contain any other files or folders except for .txt files.
  • A single file can contain a maximum of 100,000 rows.
  • A single file cannot exceed 300 MB.
  • A maximum of 10,000 list files can be stored in the folder.
  • The files must be in UTF-8 without BOM.
  • The length of each line in a file cannot exceed 65,535 characters, or the migration will fail.
  • The Content-Encoding metadata of the files must be left empty, or the migration will fail.
  • In the files, a tab character (\t) must be used to separate the URL and new file name in each line. The format is [URL][Tab character][New file name]. Only the Chinese and special characters in the file names must be URL encoded.
  • Spaces are not allowed in each line in a file. Spaces may cause migration failures because they may be mistakenly identified as object names.
Table 2 Constraints on file system migration

Scenario

Constraint

Migration source: SMB systems

  • File systems where a single directory contains more than 5 million files cannot be migrated.
  • Resumable transfer is not supported.
  • Symbolic links cannot be migrated.

Migration source: NAS file systems

  • The following types of files can be migrated: regular files, directories, symbolic link files, and hard link files.
    CAUTION:

    If the file handle of a source file is occupied or the source file is deleted, the migration of the file will fail.

  • Special files such as character device files, block device files, sockets, and pipe files cannot be migrated.
  • The metadata of symbolic link files cannot be migrated.

We use cookies to improve our site and your experience. By continuing to browse our site you accept our cookie policy. Find out more

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback