Updated on 2025-09-09 GMT+08:00

DWS Connection Parameters

Table 1 DWS connection

Parameter

Mandatory

Description

Data Connection Type

Yes

DWS is selected and cannot be changed.

Name

Yes

Name of the data connection to create. Data connection names can contain a maximum of 100 characters. They can contain only letters, digits, underscores (_), and hyphens (-).

Description

No

A description which can help identify the data connection more easily. It can contain a maximum of 100 characters.

Tag

No

Attribute of the data connection to create. Tags make management easier.
NOTE:

The tag name can contain only letters, digits, and underscores (_) and cannot start with an underscore (_) or contain more than 100 characters.

Applicable Modules

Yes

Select the modules for which this connection is available.

NOTE:
  • When offline or real-time data migration jobs are enabled, you can select the DataArts Migration module. Then you can select this data connection when creating a data migration job in DataArts Factory.
  • You can use offline or real-time data migration jobs only after you apply for the whitelist membership. To use this feature, contact customer service or technical support.

Basic and Network Connectivity Configuration

SSL Encryption

Yes

DWS supports SSL encryption and certificate authentication for communication between the client and server. You can set this parameter based on whether SSL connection is mandatory on the server.
  • If this parameter is enabled, only SSL encryption can be used for communication.
  • If this parameter is disabled, both SSL encryption and certificate authentication can be used for communication.

Manual

Yes

Select either of the following modes:

  • Cluster Name Mode: Select an existing cluster.
  • Connection String Mode: Enter the IP address/domain name and port of the corresponding cluster and enable the communication between the connection's agent (CDM cluster) and the DWS cluster.
    NOTE:

    DataArts Security does not support DWS connections in string mode.

DWS Cluster Name

Yes

This parameter is mandatory when Manual is set to Cluster Name Mode.

Select a DWS cluster from all the DWS clusters with the same project ID and enterprise project.

JDBC IP Address or Domain Name

No

This parameter is mandatory when Manual is set to Cluster Name Mode.

Select a DWS ELB domain name or ELB IP address. The former is recommended. If it is not supported, select an ELB IP address.

IP Address or Domain Name

Yes

This parameter is mandatory when Manual is set to Connection String Mode.

This parameter indicates the address for accessing the cluster database through an internal network. Enter an IP address or domain name. The IP address or domain name is automatically generated during cluster creation. You can obtain them on the management console by performing the following operations:
  1. Log in to the DWS console.
  2. In the left navigation pane, choose Instances.
  3. Click the name of an instance to enter the basic information page. In the Connection Information area, you can obtain the private IP address, domain name, and port number.

Port

Yes

This parameter is mandatory when Manual is set to Connection String Mode.

This parameter indicates the database port number specified during the DWS cluster creation. Ensure that you have enabled this port in the security group rule so that the DataArts Studio instance can connect to the database in the DWS cluster through this port.

KMS Key

Yes

KMS key used to encrypt and decrypt data source authentication information. Select a default or custom key.
NOTE:
  • When you use KMS for encryption through DataArts Studio or KPS for the first time, the default key dlf/default or kps/default is automatically generated. For more information about default keys, see What Is a Default Master Key?.
  • Only symmetric keys are supported. Asymmetric keys are not supported.

Agent

Yes

Data Warehouse Service (DWS) is not a fully managed service and thus cannot be directly connected to DataArts Studio. A CDM cluster can provide an agent for DataArts Studio to communicate with non-fully-managed services. Therefore, you need to select a CDM cluster when creating a DWS data connection. If no CDM cluster is available, create one first by referring to Creating a CDM Cluster.

As a network proxy, the CDM cluster must be able to communicate with the DWS cluster. To ensure network connectivity, the CDM cluster must be in the same region and AZ and use the same VPC and subnet as the DWS cluster. The security group rule must also allow the CDM cluster communicate with the DWS cluster.

NOTE:

If a CDM cluster functions as the agent for a data connection in Management Center, the cluster supports a maximum of 200 concurrent active threads. If multiple data connections share an agent, a maximum of 200 SQL, Shell, and Python scripts submitted through the connections can run concurrently. Excess tasks will be queued. You are advised to plan multiple agents based on the workload.

Data Source Authentication and Other Function Configuration

Username

Yes

The database username, which is specified when the DWS cluster is created.

Password

Yes

The password for accessing the database, which is specified when the DWS cluster is created.

Data Integration Configuration

Database Name

Yes

This parameter is displayed when DataArts Migration is selected for Applicable Modules.

Name of the database to connect

Fetch Size

No

This parameter is displayed when DataArts Migration is selected for Applicable Modules.

Number of rows obtained by each request. Set this parameter based on the data source and the job's data size. If the value is either too large or too small, the job may run for a long time.

Link Attributes

No

This parameter is displayed when DataArts Migration is selected for Applicable Modules.

(Optional) Click Add to add the JDBC connector attributes of multiple specified data sources. For details, see the JDBC connector document of the corresponding database.

The following are some examples:
  • connectTimeout=360000 and socketTimeout=360000: When a large amount of data needs to be migrated or the entire table is retrieved using query statements, the migration fails due to connection timeout. In this case, you can customize the connection timeout interval (ms) and socket timeout interval (ms) to prevent failures caused by timeout.
  • useCursorFetch=false: By default, useCursorFetch is enabled, indicating that the JDBC connector communicates with relational databases using a binary protocol. Some third-party systems may have compatibility issues, causing migration time conversion errors. In this case, you can disable this function. Open-source MySQL databases support the useCursorFetch parameter, and you do not need to set this parameter.

Reference Sign

No

This parameter is displayed when DataArts Migration is selected for Applicable Modules.

(Optional) Delimiter between the names of the referenced tables or columns. For details, see the product documentation of the corresponding database.