Help Center/ Migration Center/ User Guide/ Big Data Verification/ Preparations
Updated on 2024-10-21 GMT+08:00
View PDF
Share

Preparations

Before using big data verification, complete the following preparations:

Creating a Migration Project

Migration projects allow you to group, isolate, and manage migration resources. For details, see Managing Migration Projects.

Preparing Edge

To verify big data consistency, you need to install Edge for Linux in your source environment. For details, see Installing Edge for Linux. After Edge is installed, connect Edge to MgC. For details, see Connecting the Edge Device to MgC.

Edge does not support automatic restart. Do not restart Edge during task execution, or tasks will fail.

Enabling Big Data Verification

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Migrate > Big Data Verification. In the upper left corner of the page, choose the migration project you created from the project drop-down list
  3. Click Select Edge Device.
  4. In the displayed dialog box, select the Edge device you connected to MgC from the drop-down list.

    • If an Edge device is Online and Enabled, the device has been used for big data verification in a project. You can click Confirm to continue using the tool.
    • If an Edge device is Online and Disabled, the device has not been used for big data verification in any project, and you can click Enable to use this device for big data verification.
    • If an Edge device is Offline and Deleted, the device has been deleted, and it cannot be used for big data verification. However, if this device has been used for big data verification before being deleted, you can select it and click View to view the verification tasks and results.
    • If an Edge device is Offline and Disabled, the device cannot be used for big data verification, and all operation buttons are disabled even if you select it and click View.

      Before performing big data verification, ensure that the selected Edge device is Online and Enabled.

Preparing Executors

Executors are used to obtain data from the source and the target for big data verification. You need to install the CLI clients required by the involved big data components on the executors. Then the executors can interact with the big data components to obtain necessary data.

To ensure that the clients can connect to the clusters for executing verification tasks, ensure that the hosts file of the executors contains the hostnames and IP addresses of all nodes in the clusters, and that the security groups of the clusters allow access from the executors on all ports. For details, see Adding a Security Group Rule.

For details about how to install an MRS client, see Installing a Client (MRS 3.x or Later). The server where the client is installed should have at least 16 CPUs and 32 GB of memory.

Parent topic: Big Data Verification