Updated on 2022-09-16 GMT+08:00

Migration Evaluation

Evaluate and verify data migration before migrating your database to a cloud platform.

Based on the status of the data to be migrated and the future service scale, evaluate migration scenarios separately and make the required preparations.

Table 1 Evaluation and preparation before data migration

Item

Description

Amount of the data to be migrated and class of the required DDM instance and RDS MySQL DB instance

  • Use vertical sharding, then horizontal sharding to shard a source RDS MySQL DB instance.
  • Execute the following SQL statement to evaluate storage space occupied by the source RDS MySQL DB instance:
    select concat(round(sum(DATA_LENGTH/1024/1024),2),'MB')as data from information_schema.TABLES;
  • Partition a table with more than 10 million rows (or expected to exceed 10 million rows).
  • Ensure that data stored on a single RDS DB instance does not exceed 500 GB.

Information about schemas and logical tables mapped to each table in the source database

  • Specify the information about logical tables mapped to each source table, including the number of data records, logical table type, schema, DDM instance, and associated RDS DB instances.
  • If there is an RDS MySQL DB instance available in the destination DDM instance and the target schema is unsharded, associate the DB instance with the schema without the need to migrate table structures and data.

Compatibility

  • Check whether the source database uses the same MySQL version as the target MySQL DB instance associated with the destination DDM instance.
  • The class and storage space of the destination instance cannot be less than those of the source database.
  • Check whether the table structure and character set of the source database are the same as those of the destination instance.
  • For a logical table that uses hash sharding, ensure that the number of data records to be migrated each time does not exceed 10 million. For a logical table using range sharding, the number cannot exceed 5 million.
  • If a table contains a huge number of data records, export the data in batches. Specify the WHERE condition on mysqldump to limit the number of data records to be exported at a time.
  • SQL text files imported into DDM can only contain standard DML INSERT statements.
  • Evaluate the compatibility of SQL statements in your application with DDM.

Before migrating data, collect the required information listed in Table 2.

Table 2 Information to be collected

Source/Destination

Information Item

Source RDS MySQL DB instance

Connection address

Listening port

Database account

Database name

Table name

Destination DDM instance

Connection address

Listening port

Username

Name of a shard on the target DB instance

Connection address of the target DB instance

Listening port of the target RDS DB instance

Administrator of the RDS MySQL DB instance

Database name

ECS

EIP

Login credentials (username and password)