Creating a Connection to a Target Cloud Service
To verify the consistency of data stored using big data cloud services, you need to establish connections between MgC and the source and target cloud services.
The supported target big data cloud services include:
- Data Lake Insight (DLI)
- CloudTable (ClickHouse)
- CloudTable (HBase)
Procedure
- Sign in to the MgC console. In the navigation pane, under Project, select a big data migration project from the drop-down list.
- In the navigation pane on the left, choose Migrate > Big Data Verification.
- In the Features area, click Preparations.
- Choose Connection Management and click Create Connection.
Figure 1 Creating a connection
- Select a big data cloud service and click Next.
- Configure the connection parameters based on the big data service you selected.
- Parameters for creating a connection to DLI
- Parameters for creating a connection to CloudTable (ClickHouse)
- Parameters for creating a connection to CloudTable (HBase)
Table 1 Parameters for creating a connection to DLI Parameter
Configuration
Connection To
Select Target.
Connection Name
The default name is DLI-4 random characters (including letters and numbers). You can also customize a name.
MgC Agent
Select the MgC Agent installed in the source environment.
DLI Credential
Select the credential used for accessing DLI. For details about how to add credentials, see "Big data - DLI" in Adding Resource Credentials. If the selected credential is the one you currently use to access MgC, you can select This is my MgC credential, and the projects in the region you choose will be listed.
Region ID
Enter the code of the target region where the data to be verified is located, for example, ap-southeast-1. For details about region codes, see Endpoints.
Project ID
Enter the ID of the project where the data to be verified is managed. For details about how to obtain the project ID, see Obtaining Project Information.
Queue
Enter the name of the DLI queue to be verified. The queue must be a SQL queue.
Collect Usage Metrics
This parameter is optional. If this option is enabled, usage metrics for your big data resources will be collected during the execution of tasks created using this connection. The collected information is used to generate reports on the MgC console and for performance optimization.
NOTICE:Before using this function, ensure that the Huawei Cloud account you added to the MgC Agent has the read-only permission for MRS and DLI.
Table 2 Parameters required for creating a connection to CloudTable (ClickHouse) Parameter
Configuration
Connection To
Select Target.
Connection Name
The default name is CloudTable-ClickHouse4 random characters (including letters and numbers). You can also customize a name.
MgC Agent
Select the MgC Agent installed in the source environment.
CloudTable (ClickHouse) Credential
Select the credential of the CloudTable (ClickHouse) cluster. For details about how to add credentials, see "Big data - ClickHouse" in Adding Resource Credentials. When you add the credential, select Username/Password for Authentication and enter the username and password for logging in to the ClickHouse cluster created on CloudTable.
Database URL
Enter the URL to access the CloudTable (ClickHouse) database. You can obtain the access address from the basic information of the ClickHouse cluster.
Table 3 Parameters required for creating a connection to CloudTable (HBase) Parameter
Configuration
Connection To
Select Target.
Connection Name
The default name is CloudTable-HBase4 random characters (including letters and numbers). You can also customize a name.
MgC Agent
Select the MgC Agent installed in the source environment.
CloudTable (HBase) Credential
No credential is required for unsecured clusters.
Secured Cluster
Currently, only unsecured clusters (common clusters) are supported.
Database URL
Enter the URL to access the CloudTable (HBase) database. You can obtain the access address from the basic information of the HBase cluster. The address displayed after ZK Link (Intranet) is one you need.
- Click Test. MgC verifies whether the cloud service can be connected using the configuration information. If the test is successful, the cloud services can be connected.
- After the connection test is successful, click Confirm. The cloud service connection is created.
- On the Connection Management page, view the created connection and its basic information. In the Operation column, click Modify to modify the connection settings.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot