Creating an Executor Connection

Updated on 2025-01-06 GMT+08:00

View PDF

Executors are used to obtain data for consistency verification from the source and the target.

You need to connect the source and target executors to MgC, so that they can receive and execute commands from MgC. The supported big data components include:

Hive Metastore
Delta Lake (with metadata)
Delta Lake (without metadata)
Hudi (with metadata)
Hudi (without metadata)

CAUTION:

Ensure that CLI clients are installed on both the source and target executors.
You need to create connections to both the source and target executors.

Procedure

Sign in to the MgC console.
In the navigation pane on the left, choose Migrate > Big Data Verification. Select the created migration project in the upper left corner of the page.
In the Features area, click Connection Management.
Click Create Connection in the upper right corner of the page.

Select an executor, click Next, and set connection parameters based on Table 1.

**Table 1** Parameters for creating an executor connection
Parameter	Configuration
Connection To	Select an option as required. NOTICE: The CDH executor supports only the migration source. The MRS executor supports both the migration source and target.
Connection Name	The default name is Executor type-4 random characters (including letters and numbers). You can also customize a name.
Executor Credential	Select the login credential of the executor. For details about how to add credentials, see "Big data - Executor" in Adding Resource Credentials.
Executor IP Address	Enter the IP address for connecting to the executor.
Executor Port	Enter the port for connecting to the executor. The default port is 22.
Installation Directory	Enter the installation directory of the MRS or CDH client. That is, the directory where ./install.sh is installed.
SQL File Location	Enter a directory for storing the SQL files generated for consistency verification. You must have the read and write permissions for the folder. NOTICE: After the verification is complete, you need to manually clear the folders generated at this location to release storage space.

Click Test. MgC verifies whether the executor can be connected using the configuration information. If the test is successful, the executor can be connected.
After the connection test is successful, click Confirm. The executor connection is created.
On the Connection Management page, view the created connection and its basic information. In the Operation column, click Modify to modify the connection settings.

Parent topic: Creating a Connection to the Target

Previous topic: Creating a Connection to the Target

Next topic: Creating a Connection to a Target Cloud Service

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot