Updated on 2025-02-17 GMT+08:00

Creating a Connection to a Target Cloud Service

To verify the consistency of data stored using big data cloud services, you need to establish connections between MgC and the source and target cloud services.

The supported target big data cloud services include:

  • Data Lake Insight (DLI)
  • CloudTable (ClickHouse)
  • CloudTable (HBase)

Procedure

  1. Sign in to the MgC console. In the navigation pane, under Project, select a big data migration project from the drop-down list.
  2. In the navigation pane on the left, choose Migrate > Big Data Verification.
  3. In the Features area, click Preparations.
  4. Choose Connection Management and click Create Connection.

    Figure 1 Creating a connection

  5. Select a big data cloud service and click Next.
  6. Configure the connection parameters based on the big data service you selected.

    Table 1 Parameters for creating a connection to DLI

    Parameter

    Configuration

    Connection To

    Select Target.

    Connection Name

    The default name is DLI-4 random characters (including letters and numbers). You can also customize a name.

    MgC Agent

    Select the MgC Agent installed in the source environment.

    DLI Credential

    Select the credential used for accessing DLI. For details about how to add credentials, see "Big data - DLI" in Adding Resource Credentials. If the selected credential is the one you currently use to access MgC, you can select This is my MgC credential, and the projects in the region you choose will be listed.

    Region ID

    Enter the code of the target region where the data to be verified is located, for example, ap-southeast-1. For details about region codes, see Endpoints.

    Project ID

    Enter the ID of the project where the data to be verified is managed. For details about how to obtain the project ID, see Obtaining Project Information.

    Queue

    Enter the name of the DLI queue to be verified. The queue must be a SQL queue.

    Collect Usage Metrics

    This parameter is optional. If this option is enabled, usage metrics for your big data resources will be collected during the execution of tasks created using this connection. The collected information is used to generate reports on the MgC console and for performance optimization.

    NOTICE:

    Before using this function, ensure that the Huawei Cloud account you added to the MgC Agent has the read-only permission for MRS and DLI.

    Table 2 Parameters required for creating a connection to CloudTable (ClickHouse)

    Parameter

    Configuration

    Connection To

    Select Target.

    Connection Name

    The default name is CloudTable-ClickHouse4 random characters (including letters and numbers). You can also customize a name.

    MgC Agent

    Select the MgC Agent installed in the source environment.

    CloudTable (ClickHouse) Credential

    Select the credential of the CloudTable (ClickHouse) cluster. For details about how to add credentials, see "Big data - ClickHouse" in Adding Resource Credentials. When you add the credential, select Username/Password for Authentication and enter the username and password for logging in to the ClickHouse cluster created on CloudTable.

    Database URL

    Enter the URL to access the CloudTable (ClickHouse) database. You can obtain the access address from the basic information of the ClickHouse cluster.

    Table 3 Parameters required for creating a connection to CloudTable (HBase)

    Parameter

    Configuration

    Connection To

    Select Target.

    Connection Name

    The default name is CloudTable-HBase4 random characters (including letters and numbers). You can also customize a name.

    MgC Agent

    Select the MgC Agent installed in the source environment.

    CloudTable (HBase) Credential

    No credential is required for unsecured clusters.

    Secured Cluster

    Currently, only unsecured clusters (common clusters) are supported.

    Database URL

    Enter the URL to access the CloudTable (HBase) database. You can obtain the access address from the basic information of the HBase cluster. The address displayed after ZK Link (Intranet) is one you need.

  7. Click Test. MgC verifies whether the cloud service can be connected using the configuration information. If the test is successful, the cloud services can be connected.
  8. After the connection test is successful, click Confirm. The cloud service connection is created.
  9. On the Connection Management page, view the created connection and its basic information. In the Operation column, click Modify to modify the connection settings.