Help Center/ Migration Center/ User Guide/ Big Data Verification/ Creating Connections/ Creating a Big Data Component Connection
Updated on 2024-10-21 GMT+08:00

Creating a Big Data Component Connection

To verify the consistency of data stored using big data components, you need to establish connections between MgC and the big data components.

The supported big data components include:

  • Doris
  • HBase
  • ClickHouse

Procedure

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Migrate > Big Data Verification. Select a migration project in the upper left corner of the page.
  3. In the Features area, click Connection Management.
  4. Click Create Connection in the upper right corner of the page.
  5. Select a big data component and click Next.
  6. Set parameters based on the big data component you selected.

    Table 1 Parameters for creating a Doris connection

    Parameter

    Configuration

    Connection Source

    Select Target.

    Connection Name

    The default name is Doris-4 random characters (including letters and numbers). You can also customize a name.

    Doris Credential

    Select the target Doris credential added to the Edge device. For details about how to add credentials, see Big data - Doris in Adding Resource Credentials.

    Database IP Address

    Enter the IP address for accessing the Doris cluster. To obtain the address, log in to FusionInsight Manager, choose Cluster > Services > Doris, and check Host Where Leader Locates.

    Database Port

    Enter the port for accessing the Doris cluster. To obtain the address, log in to FusionInsight Manager, choose Cluster > Services > Doris > Configurations, and search for query_port.

    Database Name

    Enter the name of the Doris database.

    Table 2 Parameters for creating an HBase connection

    Parameter

    Configuration

    Connection Source

    Select Target.

    Connection Name

    The default name is HBase-4 random characters (including letters and numbers). You can also customize a name.

    HBase Credential

    Select the target HBase credential added to Edge. For details about how to add credentials, see Big data - HBase in Adding Resource Credentials.

    Secured Cluster

    Choose whether the cluster is secured.

    Zookeeper IP Address

    Enter the IP address for connecting to the ZooKeeper node. You can enter the public or private IP address of the ZooKeeper server.

    ZooKeeper Port

    Enter the port number for connecting to ZooKeeper. The default value is 2181.

    HBase Version

    Select the HBase version.

    Table 3 Parameters for creating a ClickHouse connection

    Parameter

    Configuration

    Connection Source

    Select Target.

    Connection Name

    The default name is ClickHouse-4 random characters (including letters and numbers). You can also customize a name.

    ClickHouse Credential (Optional)

    Select the target ClickHouse credentials added to Edge. For details about how to add credentials, see "Big Data - ClickHouse" in Adding Resource Credentials.

    Secured Cluster

    Choose whether the cluster is secured.

    ClickHouse IP Address

    Enter the IP address of the ClickHouse server.

    HTTP Port

    If the ClickHouse cluster is unsecured, enter the HTTP port for communicating with the ClickHouse server. The default value is 8123.

    HTTP SSL/TLS Port

    If the ClickHouse cluster is secured, enter the HTTPS port for communicating with the ClickHouse server.

  7. Click Test. MgC verifies whether the component can be connected using the configuration information. If the test is successful, the cloud services can be connected.
  8. After the connection test is successful, click Confirm. The connection is created.
  9. On the Connection Management page, view the created connection and its basic information. In the Operation column, click Modify to modify the connection settings.