Verification Process

Make preparations.

• Sign up for a HUAWEI ID, enable Huawei Cloud services, and top up your account.
• Create an IAM user and obtain the required permissions and an access key for the user.
• Create a big data migration project.
• Install the MgC Agent and connect it to MgC.
• Use the MgC Agent to enable big data verification.

For details, see Preparations.

Create a source connection.

Establish a connection with the source (cloud service or component) to obtain the list of source databases and tables.

• If the source is MaxCompute or ApsaraDB for ClickHouse, see Creating a Connection to a Source Cloud Service.
• If the source is Doris, HBase, ClickHouse, Hive Metastore, Delta Lake, or Hudi, see Creating a Connection to a Source Component.

Create a metadata collection task.

Create a task to gather the information of source databases, tables, and fields.

• If the source is MaxCompute, ApsaraDB for ClickHouse, Doris, HBase, ClickHouse, or Hive Metastore, see Creating a Metadata Collection Task.
• If the source is Delta Lake (with metadata) or Hudi (with metadata), see Creating a Data Lake Metadata Collection Task.

Create a table group and add tables to the group.

Allocate source data tables to a group. The group will be used for verification. For details, see Creating a Table Group and Adding Tables to the Group.

Create a target connection.

Establish a connection with the target (executor, cloud service, or component) to query data at the target.

• If the target is MRS Hive, Delta Lake, or Hudi, see Creating an Executor Connection.
• If the target is DLI, CloudTable (ClickHouse), or CloudTable (HBase), see Creating a Connection to a Target Cloud Service.
• If the target is Doris, HBase, or Hive Metastore, see Creating a Connection to a Target Component.

Create and execute verification tasks.

Create a verification task for the source and the target separately. For details, see Creating and Executing Verification Tasks.

View verification results.

After the verification tasks on the source and the target are executed, view and export the verification results. For details, see Viewing and Exporting Verification Results.