- What's New
- Function Overview
- Service Overview
- Getting Started
-
User Guide
-
New Edition
- Permissions Management
- Settings Management
- Surveys
- Resource Discovery
- Application Management
- Migration Preparations
- Migration Solutions
- Migration Plans
- Migration Clusters
- Migration Workflows
- Big Data Migration (from MaxCompute to DLI)
- Big Data Verification
-
Old Edition
- Permissions Management
- Settings Management
- Migration Surveys
- Resource Discovery
- Application Management
- Big Data Lineage
- Migration Solutions
- Migration Plans
- Migration Clusters
- Migration Workflows
- Big Data Migration
- Big Data Verification
-
New Edition
-
MgC Agent Usage Guide
- MgC Agent Overview
- Downloading and Installing the MgC Agent (Formerly Edge)
- Local Discovery and Collection
- Connecting the MgC Agent to MgC
- Agent-based Discovery
-
Collector-based Discovery
- Creating a Collection Task
- Managing Collectors
-
Configuring Collector Parameters
- Kubernetes Static Collector (app-discovery-k8s)
- Kubernetes Conntrack Collector (app-discovery-k8s-conntrack)
- Kubernetes Pod Network Collector (app-discovery-k8s-pod-net)
- Process and Network Collector (app-discovery-process-netstat)
- Windows Process and Network Collector (app-discovery-process-netstat-win)
- RabbitMQ Collector (app-discovery-rabbitmq)
- Kafka Collector (app-discovery-kafka)
- Eureka Collector (app-discovery-eureka)
- Redis Collector (app-discovery-redis)
- MongoDB Collector (app-discovery-mongodb)
- MySQL-General Log Collector (app-discovery-mysql-generallog)
- MySQL-JDBC Collector (app-discovery-mysql-jdbc)
- Nginx Configuration Collector (app-discovery-nginx)
- Cloud VPC Log Collector (app-discovery-cloud-vpc-log)
- Nacos Collector (app-discovery-nacos)
- Application Configuration Collector (app-discovery-application-config)
- Best Practices
-
FAQs
- What Are the Requirements for the Server for Installing the MgC Agent (Formerly Edge)?
- How Do I Run the MgC Agent in Compatibility Mode?
- What Can I Do If the MgC Agent (Formerly Edge) Is Offline?
- Why Can't the MgC Agent (Formerly Edge) Start After Being Installed?
- How Do I Upgrade the MgC Agent (Formerly Edge) to the Latest Version?
- How Do I Uninstall the MgC Agent (Formerly Edge)?
- How Do I Restart the MgC Agent (Formerly Edge)?
- How Do I Check the Current MgC Agent Version (Formerly Edge)?
- How Do I Obtain Run Logs of the MgC Agent (Formerly Edge) on Linux?
- How Do I Fix the Error "The collector is not installed" When a Discovery Task Fails?
- How Do I Obtain the Hive Metastore Credential Files?
- What Can I Do If the Port Required by the MgC Agent Is Occupied and the Installation Fails?
- What Can I Do If AK/SK Verification Fails?
- How Do I Configure WinRM and Troubleshoot WinRM Connection Problems?
- What Do I Do If the Credential List Is Empty When I Create a Data Connection for Big Data Verification?
-
Best Practices
- Configuring Permissions Required for Server Migration
-
Server Migration
- Network Requirements for Server Migration
- Migrating On-premises Servers to Huawei Cloud
- Migrating Servers from Alibaba Cloud to Huawei Cloud
- One-stop Cross-AZ ECS Migration
- Migrating Servers Across AZs on Huawei Cloud
- Migrating Servers to FlexusX Instances (Original HECS X Instances)
- Keeping Private IP Addresses of Servers Unchanged After the Migration
- Batch Modifying and Restoring the Host Configurations for Linux Source Servers
- Batch Modifying and Restoring the Host Configurations for Windows Source Servers
-
Storage Migration
- Migrating Data from Other Cloud Platforms to Huawei Cloud
- Migrating Data from Multiple Source Buckets by Prefix
- Migrating Archive (Cold) Data
- Migrating Data from SFS 1.0 to SFS 3.0
- Performing a NAS-to-NAS Migration and Service Cutover
- Migrating File Systems in Batches
- Migrating Data from MinIO to Huawei Cloud OBS over HTTP
- Migrating Data from Ceph to Huawei Cloud OBS over HTTP
- Reducing Disk Capacity for Target Servers
- Resizing Disks and Partitions for Target Servers
- Collecting Details of Azure Kubernetes Service (AKS) Resources
- Collecting Details of Google Cloud GKE Resources
- Collecting Details of AWS Container Resources
- Collecting Details of Self-built Oracle Databases
-
Verifying Big Data Consistency After Migration
- Verifying the Consistency of Data Migrated from MaxCompute to DLI
- Verifying the Consistency of Data Migrated Between MRS ClickHouse Clusters
- Verifying the Consistency of Data Migrated from Alibaba Cloud EMR ClickHouse to Huawei Cloud MRS ClickHouse
- Verifying the Consistency of Data Migrated from Alibaba Cloud ApsaraDB for ClickHouse to Huawei Cloud MRS ClickHouse
- Verifying the Consistency of Data Migrated from Alibaba Cloud ApsaraDB for ClickHouse to Huawei Cloud CloudTable ClickHouse
- Verifying the Consistency of Data Migrated Between MRS Doris Clusters
- Verifying the Consistency of Data Migrated Between MRS Doris Clusters or from CDH or EMR to MRS Doris
- Verifying the Consistency of Data Migrated from Alibaba Cloud MaxCompute to Huawei Cloud DLI
- Verifying the Consistency of Data Migrated Between MRS HBase Clusters
- Verifying the Consistency of Data Migrated from Delta Lake (with Metadata) to MRS Delta Lake
- Verifying the Consistency of Data Migrated from Delta Lake (without Metadata) to MRS Delta Lake
- Migrating Big Data Without Using the Internet
- BigData Migration Cockpit
-
FAQs
-
Product Consultation
- How Do I Assign the Permissions Required for Using MgC to IAM Users?
- Where Is MgC Available?
- How Do I Prepare for Using MgC?
- How Do I Fix the Error "Failed to access IAM. Check the current user's IAM permissions"?
- Why Can't I Sign the Privacy Statement and Use MgC?
- How Does MgC Ensure Data Security?
- Does Data Collection Affect My Source Services?
-
Network Settings
- What Can I Do If a Source Server Fails the Migration Readiness Check Because Its IP address or Port Is Unreachable?
- What Can I Do If a Source Server Fails the Migration Readiness Check Because the Username or Password Is Incorrect?
- How Do I Fix the Error "Deliver Command to Edge Failed" When a Source Server Fails the Migration Readiness Check?
- What Can I Do If a Source Server Fails the Migration Readiness Check Due to an Unreachable Port, Incorrect Firewall Settings, or Insufficient Access Permissions?
- What Can I Do If Deep Collection Fails on a Source Server Due to Disabled WinRM or an Unreachable IP Address or Port?
-
Server Migration
- How Do I View the Migration Progress When the Migration Workflow Is in the Running State?
- Why the Workflow Status Is Always "Running"?
- How Do I Fix the Error "Edge is not accessible" When a Step in the Migration Workflow Fails?
- How Do I Fix the Error "Server Require to Bind Credential First..." When the Migration Workflow Fails on a Source Server?
- How Do I Handle Resource Exceptions during a Batch Server Migration?
- What Are the Known Errors Related to Server Migration Workflows and How Can I Fix Them?
- What Can I Do If an Error Occurs During the Migration of a VMware Server?
- What Are the Information Mappings Between MgC and SMS?
- Why Is the Migration Progress Inconsistent Between MgC and SMS?
- What Do I Do If I Use a sudo User to Migrate a Source Server and the Server Fails the Source Environment Check?
- What Can I Do If the StartUpAgent Step Fails and the Error Message "System.OutOfMemoryException" Is Displayed?
- How Do I Fix the Error "SMS-Workflow.0503: SMS migration task failed. SMS.xxxx?"
- What Do I Do If Some Disks Are Not Attached to the Target Server After the Migration Is Complete?
-
Storage Migration
- What Are the Restrictions on Using MgC for Storage Migration?
- What Are the Requirements for the Source and Target Environments?
- How Do I Choose the Right Specifications for a Migration Cluster?
- What Affects the Migration Speed of Large Objects?
- What Affects the Migration Speed of Small Objects?
- How Do I View Key Metrics that Affect the Migration Speed?
- Why Is My Storage Migration Workflow Stalled for a Long Time?
- When I Migrate HTTP/HTTPS Data to Huawei Cloud OBS, How Are the Objects with the Same Name but Different URLs Processed?
- When I Migrate Data from OBS to NAS on Huawei Cloud, How Are Objects with the Same Name but Different Capitalization Processed?
- What Are the Constraints on the Length of Object Paths for Migrations Between OBS, NAS, and SMB Storage Systems on Huawei Cloud?
- How Do I Resolve the Problem that a Migration Cluster Fails to Be Created?
- How Do I Obtain Credentials for Accessing Microsoft Azure?
- What Do I Do If the Storage Migration Workflow Fails and "COMPARISON_ATTRIBUTE_NOT_SAME" Is Displayed?
- How Do I Choose Storage Classes?
- What Do I Do If a Migration Task Fails?
- Cross-AZ Migration
- Migration Surveys
-
Resource Discovery
- Known Resource Discovery Problems and Solutions
- Where Can I Find the Collection Failure Cause?
- What Can I Do If an Internet Discovery Task Fails and the Error Message "Network connection timed out" or "Other exception" Is Displayed?
- How Do I Collect Data from a Data Source Again If the Previous Collection Fails?
- How Do I Obtain the Cloud Platform Credentials (AK/SK Pairs)?
- How Do I Obtain the Information for Adding Azure Credentials to MgC?
- How Do I Obtain the Required Credentials Before Using MgC to Perform a Deep Collection for My Azure Object Storage Resources?
- How Do I Configure the Permissions Required for Collecting Details of Azure Containers?
- How Do I Convert the Encoding Format of a CSV File to UTF-8?
- What Can I Do If the Collected Disk Information Is Empty or Incorrect After a Deep Collection Is Performed for a Windows Source Server?
- What Can I Do If the Collected OS Information Is Incorrect After a Deep Collection Is Performed for a Windows Source Server?
- What Can I Do If an RVTools Import Fails?
- What Do I Do If the Deep Collection Succeeds on a Source Server but Some Specifications Information Is Not Collected?
-
Target Recommendations
- Where Can I Find the Assessment Failure Cause?
- Why Can't I Manually Select Target Server Specifications and Disk Types?
- What Can I Do If a Server Assessment Fails and the System Displays a Message Indicating No Proper Specifications Are Matched?
- What Can I Do If a Server Assessment Fails Because the Target Server Specifications Do Not Support Windows Images?
- What Types of Databases Can I Assess Using MgC?
- How Does MgC Generate Target Recommendations?
- Big Data Migration
-
Big Data Verification
- What Do I Do If the Credential List Is Empty When I Create a Data Connection for Big Data Verification?
- Why Are 0 or -1 Displayed in the Hive Verification Results?
- Why Does a Field in Hive Fail the Sum Verification?
- Why Do a Large Number of Tables Fail to Be Verified in a DLI Verification Task?
- How Do I Optimize the Verification Task When the Delta Lake Data Volume Is Large?
- How Do I Replace Packages Before I Create a Connection to a Secured HBase Cluster on the Target Cloud?
- How Do I Replace Packages When I Create a Verification Task for an MRS 3.1.0 Cluster Using Yarn?
- Known Issues and Solutions
-
Product Consultation
- General Reference
Copied.
Creating a Migration Cluster
You can create dedicated migration clusters to accelerate storage migration. A migration cluster consists of nodes that have the migration plugin installed and are used to execute migration and listing tasks.
Precautions
- A maximum of two migration clusters can be created in each region in an account.
- To ensure migration stability and data security, you are not allowed to log in to nodes in migration clusters. If you indeed need to log in to the nodes, contact technical support.
- If a migration cluster is idle for more than 30 days, its status will change to Discarded. The cluster will not be deleted but cannot be restored.
- You can see the details about resources contained in a migration cluster and the security group settings of all cluster nodes in Migration Cluster Resources and Settings.
Billing
You are billed at standards rates for migration clusters and additional resources used during migrations.
- Master, migration, and list nodes in migration clusters are all ECSs, and you pay for these ECSs. For details, see ECS Pay-per-Use Billing or ECS Price Calculator.
- If you migrate over the Internet, you need to pay for NAT gateways used by migration clusters. For details, see NAT Gateway Billing or NAT Gateway Price Calculator.
- If you choose to enable log collection, you need to pay Log Tank Service (LTS) for resources you consume. For details, see LTS Billing or LTS Price Calculator.
Procedure
- Sign in to the MgC console. In the navigation pane, under Project, select an application migration project from the drop-down list.
- In the navigation pane, choose Deploy > Migration Clusters.
- Click Create Cluster in the upper right corner of the page.
If this is your first time to create a migration cluster, you need to delegate MgC the required permissions. Click
to view the permissions to be assigned.
- Configure the parameters listed in Table 1.
Table 1 Parameters for creating a cluster Area
Parameter
Configuration
Constraints
Basic Settings
Cluster Name
Enter a name.
The cluster name must be unique in the same account.
Region
Select the region to provision the cluster.
The cluster must be provisioned in the target region you are migrating to.
Cluster Type
Select what the cluster will be used for.
Currently, only storage migration is supported.
Node Settings
Master Node
It is used to manage migration nodes and list nodes.
A cluster can only have one master node.
Migration Node
Migration nodes are used for executing migration and verification tasks. The recommended specifications are 8 vCPUs and 16 GB of memory.
- The node specifications cannot be modified after the cluster is created.
- The number of nodes must meet the following requirements:
- Number of migration nodes + Number of list nodes + 1 ≤ 100
- Number of migration nodes + Number of list nodes + 1 ≤ Number of unused IP addresses in the subnet
List Node
List nodes are used for listing tasks. The recommended specifications are 8 vCPUs and 16 GB of memory.
Network Settings
VPC
Select a VPC from the drop-down list.
-
Subnet
Make sure that there are enough unused IP addresses for the migration and list nodes in this cluster.
Number of unused IP addresses in the subnet ≥ Number of migration nodes + Number of list nodes + 1
Network Type
- Internet: You need to select a public NAT gateway. If there is no gateway available, choose Buy Gateway from the drop-down list and select the gateway specifications and EIPs you want to associate with the gateway. A maximum of 20 EIPs can be selected at a time.
- Intranet: This option is suitable for data migration within a region.
- Private line: Source data is directly accessed through the private line. For details about Direct Connect, see Direct Connect.
-
Advanced Settings
DNS Configuration (Optional)
Enter the IP address of the DNS server to update the value of nameserver in the /etc/resolv.conf file. Use commas (,) to separate multiple DNS server addresses, for example, 192.0.2.1,192.0.2.2.
A maximum of three DNS IP addresses can be specified.
Domain Mapping (Optional)
Add mappings between domain names and IP addresses to update the /etc/hosts file.
A maximum of 500 mappings can be added.
-
Traffic Limiting
Allocate the maximum bandwidth to be used by the workflow during a specified period.
- If you do not select this option, migration traffic is not limited.
- If you select this option, limit the migration traffic by setting the start time, end time, and bandwidth limit.
NOTICE:
For example, if you set Start Time to 08:00, End Time to 12:00, and Maximum Bandwidth to 20 MB/s, the maximum migration speed is limited to 20 MB/s when the migration task is running in the period from 08:00 to 12:00. The migration speed is not limited beyond this period.
- A maximum of five traffic limiting rules can be added.
- The time is the local standard time of the region you are migrating to.
Log Collection
- If this option is enabled, logs generated during the migration are collected for possible troubleshooting later.
- If this option is disabled, logs generated during storage migrations are not collected.
-
- Click Confirm. Then you can view the cluster in the list. For details about cluster statuses, see Cluster Statuses. If the cluster status is Creation failed, move the cursor to the status to view the failure cause. After the fault is rectified, choose More > Retry to try to create the cluster again.
- After the migration cluster is created, perform the following operations:
- If the cluster status is Healthy or Subhealthy, click Create Workflow in the Operation column to .
- Click Manage in the Operation column to add or delete nodes and traffic limiting rules for the cluster. For details, see Managing a Migration Cluster.
Upgrading Plug-ins
You can upgrade the migration plugin to the latest version for a cluster by choosing More > Upgrade Plugin in the Operation column.
Deleting a Migration Cluster
If a migration cluster is no longer needed after your data migration is complete, you can delete the cluster and the associated resources.
- In the cluster list, locate the cluster to be deleted and choose More > Delete in the Operation column.
- Select whether to delete associated resources and click OK.
Retrying to Create a Migration Cluster
If a migration cluster fails to be created, after you rectify the fault, you can try to create the cluster again by choosing More > Retry in the Operation column.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot