Help Center/ Migration Center/ User Guide/ Big Data Verification/ Creating a Connection to the Target/ Creating an Executor Connection
Updated on 2024-12-03 GMT+08:00
View PDF
Share

Creating an Executor Connection

Executors are used to obtain data for consistency verification from the source and the target.

You need to connect the source and target executors to MgC, so that they can receive and execute commands from MgC. The supported big data components include:

  • Hive Metastore
  • Delta Lake (with metadata)
  • Delta Lake (without metadata)
  • Hudi (with metadata)
  • Hudi (without metadata)
  • Ensure that CLI clients are installed on both the source and target executors.
  • You need to create connections to both the source and target executors.

Procedure

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Migrate > Big Data Verification. Select the created migration project in the upper left corner of the page.
  3. In the Features area, click Connection Management.
  4. Click Create Connection in the upper right corner of the page.
  5. Select an executor, click Next, and set connection parameters based on Table 1.

    Table 1 Parameters for creating an executor connection

    Parameter

    Configuration

    Connection To

    Select an option as required.

    NOTICE:

    The CDH executor supports only the migration source. The MRS executor supports both the migration source and target.

    Connection Name

    The default name is Executor type-4 random characters (including letters and numbers). You can also customize a name.

    Executor Credential

    Select the login credential of the executor. For details about how to add credentials, see "Big data - Executor" in Adding Resource Credentials.

    Executor IP Address

    Enter the IP address for connecting to the executor.

    Executor Port

    Enter the port for connecting to the executor. The default port is 22.

    Installation Directory

    Enter the installation directory of the MRS or CDH client. That is, the directory where ./install.sh is installed.

    SQL File Location

    Enter a directory for storing the SQL files generated for consistency verification. You must have the read and write permissions for the folder.

    NOTICE:

    After the verification is complete, you need to manually clear the folders generated at this location to release storage space.

  6. Click Test. MgC verifies whether the executor can be connected using the configuration information. If the test is successful, the executor can be connected.
  7. After the connection test is successful, click Confirm. The executor connection is created.
  8. On the Connection Management page, view the created connection and its basic information. In the Operation column, click Modify to modify the connection settings.