Updated on 2025-05-20 GMT+08:00

Connecting to a Doris Data Source

DataArts Insight allows you to connect to a Doris data source. This section describes how to connect DataArts Insight to a Doris data source.

DataArts Insight can connect to Doris through the following methods:

  • Public network connection: To connect to cloud service resources that do not belong to your current account, use this method. The data source must be bound to an EIP.
  • VPC network connection: To connect to cloud service resources under your current account, use this method.
  • VPCEP service: To connect to data sources that are not associated with your current account or for which you lack VPCEP permissions, as well as ECS self-built data sources, use this method.

Preparations

Do the following to check if an EIP or a VPCEP security group is added:
  1. Log in to the management console.
  2. In the service list, choose Analytics > MapReduce Service to access the MRS console.
  3. Select a region in the upper left corner.
  4. In the navigation pane on the left, choose Clusters. The cluster list is displayed.
  5. Click the name of the cluster you want to connect to. The cluster overview page is displayed.
  6. Locate the Network Information area. Click Add Security Group Rule next to EIP. In the Add Security Group Rule dialog box, click Manage Security Group Rule. Click the Inbound Rules tab and check whether a VPC endpoint security group or EIP is added.
    • If yes, return to the DataArts Insight data source editing page to connect to the data source.
    • If no, perform the following steps to add a security group:
      1. Click Add Rule. In the displayed Add Inbound Rule dialog box, set the protocol, port, and source IP address. To add multiple rules, click Fast-Add Rule.
      2. Confirm the parameter settings and click OK to return to the DataArts Insight page and connect to the data source.

      If no EIP is bound, locate the Network Information area and click Bind next to EIP. Click Manage Security Group Rule and then the Inbound Rules tab to check or add a security group.

      If the data source connection test fails after the security group is added, the possible cause is that SASL_SSL is not enabled for that data source.

Accessing a Doris Data Source Through a Public Network

  1. Log in to the DataArts Insight console.
  2. Click in the upper left corner of the management console to select a region and select an enterprise project from Enterprise Project in the upper right corner of the Workspace page.
  3. On the top menu of the console, click Project. On the displayed My Projects page, click the name of the desired project.
  4. In the navigation pane on the left, choose Data Management > Data Sources. On the displayed page, click Create Data Source. In the slide-out panel, set Source Database Type to Doris and Access Network Type to Public network.
  5. Set other parameters based on Table 1.
    Figure 1 Connecting to a Doris data source

    Table 1 Parameters

    Parameter

    Mandatory

    Description

    Source Database Type

    Yes

    Type of the data source to be connected.

    Access Network Type

    Yes

    Select Public network for GaussDB(DWS) instances with public IP addresses, not restricted by account, region, or other limitations.

    Name

    Yes

    Name the current data connection for easier subsequent use and configuration.

    Domain Name

    Yes

    Public IP address or domain name bound to the target data source, which can be obtained from the public IP address in the Connection Information area on the GaussDB(DWS) instance details page.

    Port

    Yes

    External port of the target data source on the corresponding node, which can be obtained from the port number in the Connection Information area on the GaussDB(DWS) instance details page.

    Database

    Yes

    Select the database in the target data source based on service requirements.

    SASL_SSL

    N/A

    It is used for trusted identity authentication and secure data transmission when DataArts Insight retrieves data from the data source. This function is enabled by default.

    Username

    Yes

    Username used for connection authentication.

    Password

    Yes

    Password used for connection authentication.

  6. Click Test Connection to test the data source connectivity.
  7. Once the test is successful, click OK.

Accessing a Doris Data Source Through a VPC Network

  1. Log in to the DataArts Insight console.
  2. Click in the upper left corner of the management console to select a region and select an enterprise project from Enterprise Project in the upper right corner of the Workspace page.
  3. On the top menu of the console, click Project. On the displayed My Projects page, click the name of the desired project.
  4. In the navigation pane on the left, choose Data Management > Data Sources. On the displayed page, click Create Data Source. In the slide-out panel, set Source Database Type to Doris and Access Network Type to MRS Doris.
  5. Set other parameters based on Table 2.

    The selection of MRS instances only determines the VPC and subnet to be connected, and does not have any corresponding relationship with the server list.

    Figure 2 Parameters for connecting to a Doris cloud data source

    Table 2 Parameters

    Parameter

    Mandatory

    Description

    Source Database Type

    Yes

    Type of the accessed data source. In this example, Doris is selected.

    Access Network Type

    Yes

    In this example, MRS Doris is selected.

    Region

    Yes

    Region where the Doris service host is located.

    Name

    Yes

    Name of the data source displayed in the list.

    Description

    No

    Description of the data source.

    Instance

    Yes

    Role instance corresponding to the Doris service.

    Servers

    Yes

    List of servers where Doris is located.

    Database

    Yes

    Name of the database to be logged in to.

    Username

    Yes

    Username for logging in to the database.

    Password

    Yes

    Password for logging in to the database.

    SASL_SSL

    N/A

    It is used for trusted identity authentication and secure data transmission when DataArts Insight retrieves data from the data source. This function is enabled by default.

  6. Click Test Connection to test the data source connectivity.
  7. Once the test is successful, click OK.

Connecting to a Doris Data Source Through a VPC Endpoint Service

VPCEP enables connections to data sources using the VPCEP service name, offering flexible data access and addressing issues related to cross-account access and self-built data source access for ECS. Furthermore, the same main account and its IAM users can share a single connection channel, streamlining connection management. The existing access method eliminates the need for permission delegation, further simplifying operations.

  • Prerequisites
  • Procedure
    1. Log in to the DataArts Insight console.
    2. Click in the upper left corner of the management console to select a region and select an enterprise project from Enterprise Project in the upper right corner of the Workspace page.
    3. On the top menu of the console, click Project. On the displayed My Projects page, click the name of the desired project.
    4. In the navigation pane on the left, choose Data Management > Data Sources. On the displayed page, click Create Data Source. In the slide-out panel, set Source Database Type to Doris and Access Network Type to VPC Endpoint Service.

    5. Set other parameters based on Table 3.
      Figure 4 Connection through a VPCEP service
      Table 3 Parameters

      Parameter

      Mandatory

      Description

      Source Database Type

      Yes

      Type of the accessed data source. In this example, Doris is selected.

      Access Network Type

      Yes

      Select VPC Endpoint Service.

      Region

      Yes

      Region where the Doris service host is located.

      Name

      Yes

      Name of the data source displayed in the list, which is user-defined.

      Description

      No

      Description of the data source.

      VPC Endpoint Service

      Yes

      Name of the VPCEP service to be connected. The prerequisites for connecting to a VPCEP service are as follows:

      Verify

      N/A

      After entering the VPCEP service name, click Verify. If a green tick is displayed next to the VPC endpoint ID, the verification is successful. If a red exclamation mark () is displayed next to the VPC endpoint ID, the VPCEP service is connected to for the first time. In this case, you need to authorize the VPCEP service. To do so, log in to the VPCEP console. Under Network Console, choose VPC Endpoint > VPC Endpoint Services. On the displayed page, click the desired VPCEP service and click the Connection Management tab. On the tab page, authorize the VPCEP service. For details, see Managing Connections of a VPC Endpoint Service. Once the authorization is successful, click Verify again. The verification is successful.

      NOTE:
      • All initial connections to the VPCEP service from different data sources require approval.
      • Only an administrator account or an account with administrator permissions can approve the connection. If your current account does not have approval permissions, contact an administrator account for approval.

      VPC Endpoint ID

      Yes

      This parameter is automatically filled in once you entered the VPCEP name and clicked Verify.

      Port

      Yes

      Port number for logging in to the database.

      Database

      Yes

      Name of the database to be logged in to.

      Username

      Yes

      Username for logging in to the database.

      Password

      Yes

      Password for logging in to the database.

      SASL_SSL

      N/A

      It is used for trusted identity authentication and secure data transmission when DataArts Insight retrieves data from the data source. This function is enabled by default.

    6. Click Test Connection to test the data source connectivity.
    7. Once the test is successful, click OK.