Updated on 2024-11-20 GMT+08:00

Doris Link Parameters

CDM can connect to open-source Doris and MRS Doris. Table 1 lists the parameters for a Doris link.

Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.

Table 1 Doris link parameters

Parameter

Description

Example Value

Name

Link name, which should be defined based on the data source type, so it is easier to remember what the link is for

Doris_link

Database Server

One or more server lists (server domain names/IP addresses) separated by semicolons (;)

NOTE:
  • For the open-source Doris, enter the server domain names or IP addresses.
  • For MRS Doris, log in to Manager of the cluster where the MRS Doris data source is located, choose Cluster > Services > Doris > Instance, and view the MRS Doris service IP address.

    MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported.

192.168.0.1;192.168.0.2

Port

Port of the database to connect

NOTE:
  • For the open-source Doris, enter the server domain names or IP addresses.
  • For MRS Doris, log in to Manager of the cluster where the MRS Doris data source is located, choose Cluster > Services > Doris > Configurations > Basic Configurations, and view the MRS Doris service IP address.

    MRS clusters whose Kerberos encryption type is aes256-sha2,aes128-sha2 are not supported, and only MRS clusters whose Kerberos encryption type is aes256-sha1,aes128-sha1 are supported.

9030

Database Name

Name of the database to connect

dbname

Username

Username used for accessing the database This account must have the permissions required to read and write data tables and metadata.

cdm

Password

Password of the user

-

Use Agent

The agent function will be unavailable soon and does not need to be configured.

-

Agent

The agent function will be unavailable soon and does not need to be configured.

-

stream load port

Stream load port

8030

check streamLoad

Whether to check the streamLoad link

Yes

Reference Sign

(Optional) Delimiter between the names of the referenced tables or columns. For details, see the product documentation of the corresponding database.

`

Driver Version

Upload the required driver.

-

Fetch Size

(Optional) Displayed when you click Show Advanced Attributes.

Number of rows obtained by each request. Set this parameter based on the data source and the job's data size. If the value is either too large or too small, the job may run for a long time.

1000

Commit Size

(Optional) Displayed when you click Show Advanced Attributes.

Number of records submitted each time. Set this parameter based on the data destination and the job's data size. If the value is either too large or too small, the job may run for a long time.

-

Link Attributes

(Optional) Click Add to add the JDBC connector attributes of multiple specified data sources. For details, see the JDBC connector document of the corresponding database.

The following are some examples:

connectTimeout=600000 and socketTimeout=300000: When a large amount of data needs to be migrated or the entire table is retrieved using query statements, the migration fails due to connection timeout. In this case, you can customize the connection timeout interval (ms) and socket timeout interval (ms) to prevent failures caused by timeout.

sslmode=require

Link Secret Attributes

Custom secret attributes of the link

sk=09fUgD5WOF1L6f