RDS(MySQL) Connection Parameters

RDS(MySQL) connections can connect to databases such as RDS for MySQL and on-premises MySQL databases.

**Table 1** RDS connection
Parameter	Mandatory	Description
Data Connection Type	Yes	RDS(MySQL) is selected by default and cannot be changed.
Name	Yes	Name of the data connection to create. Data connection names can contain a maximum of 100 characters. They can contain only letters, digits, underscores (_), and hyphens (-).
Description	No	A description which can help identify the data connection more easily. It can contain a maximum of 100 characters.
Tag	No	Attribute of the data connection to create. Tags make management easier. NOTE: The tag name can contain only letters, digits, and underscores (_) and cannot start with an underscore (_) or contain more than 100 characters.
Applicable Modules	Yes	Select the modules for which this connection is available. NOTE: When offline or real-time data migration jobs are enabled, you can select the DataArts Migration module. Then you can select this data connection when creating a data migration job in DataArts Factory. You can use offline or real-time data migration jobs only after you apply for the whitelist membership. To use this feature, contact customer service or technical support.
Basic and Network Connectivity Configuration
IP Address or Domain Name	Yes	Address for accessing the relational database through an internal network. Enter an IP address or domain name. If the data source is RDS, you can obtain the address on the management console by performing the following operations: Log in to the management console of the corresponding cloud service using the account you have obtained. In the left navigation pane, choose Instances. Click the name of an instance to enter the basic information page. In the Connection Information area, you can obtain the private IP address, domain name, and port number. If the data source is an on-premises MySQL, you can obtain the access address from the database administrator.
Port	Yes	Port for accessing the relational database. Ensure that you have enabled this port in the security group rule so that the DataArts Studio instance can connect to this database through this port. If the data source is RDS, you can obtain the address on the management console by performing the following operations: Log in to the management console of the corresponding cloud service using the account you have obtained. In the left navigation pane, choose Instances. Click the name of an instance to enter the basic information page. In the Connection Information area, you can obtain the private IP address, domain name, and port number. If the data source is an on-premises MySQL, you can obtain the access address from the database administrator.
KMS Key	Yes	KMS key used to encrypt and decrypt data source authentication information. Select a default or custom key. NOTE: When you use KMS for encryption through DataArts Studio or KPS for the first time, the default key dlf/default or kps/default is automatically generated. For more information about default keys, see What Is a Default Master Key?. Only symmetric keys are supported. Asymmetric keys are not supported.
Agent	Yes	RDS is not a fully managed service and cannot be directly connected to DataArts Studio. A CDM cluster can provide an agent for DataArts Studio to communicate with non-fully-managed services. Therefore, you need to select a CDM cluster when creating an RDS data connection. If no CDM cluster is available, create one first by referring to Creating a CDM Cluster. As a network proxy, the CDM cluster must be able to communicate with RDS. To ensure network connectivity, the CDM cluster must be in the same region and AZ and use the same VPC and subnet as RDS. The security group rule must also allow the CDM cluster to communicate with RDS. NOTE: If a CDM cluster functions as the agent for a data connection in Management Center, the cluster supports a maximum of 200 concurrent active threads. If multiple data connections share an agent, a maximum of 200 SQL, Shell, and Python scripts submitted through the connections can run concurrently. Excess tasks will be queued. You are advised to plan multiple agents based on the workload.
SSL Encryption	No	Whether to enable SSL encrypted transmission.
Data Source Driver Configuration
Driver Name	Yes	com.mysql.jdbc.Driver: Select this driver name for RDS for MySQL or MySQL.
Driver File Path	Yes	It specifies the OBS path where the driver file is located. You need to download a .jar driver file from the corresponding official website and upload it to OBS. MySQL driver: Download it from https://downloads.mysql.com/archives/c-j/. The 5.1.48 version is recommended. NOTE: The OBS path of the driver file cannot contain Chinese characters. For security purposes, the system checks the SHA512 value and byte size of the selected driver file. If the driver file is not in the allowed list, an error message will be displayed. You are advised to use the driver file of the recommended version or contact customer service or technical support. To update the driver, you must restart the CDM cluster in DataArts Migration and then edit the data connection to upload the driver.
Data Source Authentication and Other Function Configuration
Username	Yes	The username of the database. The username is required for creating a cluster.
Password	Yes	The password for accessing the database. The password is required for creating a cluster.
Data Integration Configuration
Database Name	Yes	Name of the database to connect
Use Local API	No	(Optional) Whether to use the local API of the database for acceleration. When you create a MySQL link, CDM automatically enables the local_infile system variable of the MySQL database to enable the LOAD DATA function, which accelerates data import to the MySQL database. If this parameter is enabled, the date data that does not meet the format requirements will be stored as 0000-00-00. For details, visit the official MySQL website. If CDM fails to enable this function, contact the database administrator to enable the local_infile system variable. Alternatively, set Use Local API to No to disable API acceleration. If data is imported to RDS for MySQL, the LOAD DATA function is disabled by default. In such a case, you need to modify the parameter group of the MySQL instance and set local_infile to ON to enable the LOAD DATA function. NOTE: If local_infile on RDS is uneditable, it is the default parameter group. You need to create a parameter group, modify its values, and apply it to the RDS for MySQL instance. For details, see the Relational Database Service User Guide.
local_infile Character Set	No	This parameter is displayed when Use Local API is enabled. When using local_infile to import data to MySQL, you can configure the encoding format. The default value is utf8.
Fetch Size	No	Set the number of rows obtained by each request. Set this parameter based on the data source and the job's data size. This parameter is optional. If the value is either too large or too small, the job may run for a long time. The default value is 1,000.
Commit Size	No	Number of records submitted each time. Set this parameter based on the data destination and the job's data size. If the value is either too large or too small, the job may run for a long time. The default value is 10,000.
Batch Size	No	Number of rows written each time. This parameter is optional. It should be less than Commit Size. When the number of rows written reaches the value of Commit Size, the rows will be committed to the database. The default value is 100.
Link Attributes	No	(Optional) Click Add to add the JDBC connector attributes of multiple specified data sources. For details, see the JDBC connector document of the corresponding database. Examples for MySQL: connectTimeout=360000 and socketTimeout=360000: When a large amount of data needs to be migrated or the entire table is retrieved using query statements, the migration fails due to connection timeout. In this case, you can customize the connection timeout interval (ms) and socket timeout interval (ms) to prevent failures caused by timeout. tinyInt1isBit=false or mysql.bool.type.transform=false: By default, tinyInt1isBit is true, indicating that TINYINT(1) is processed as a bit, that is, Types.BOOLEAN, and 1 or 0 is read as true or false. As a result, the migration fails. In this case, you can set tinyInt1isBit to false to avoid migration failures. useCursorFetch=false: By default, useCursorFetch is set to true, indicating that the JDBC connector communicates with relational databases using a binary protocol. Some third-party systems may have compatibility issues, causing migration time conversion errors. In this case, you can disable this function. Open-source MySQL databases support the useCursorFetch parameter, and you do not need to set this parameter. allowPublicKeyRetrieval=true: By default, public key retrieval is disabled for MySQL databases. If TLS is unavailable and an RSA public key is used for encryption, connection to a MySQL database may fail. In this case, you can enable public key retrieval to avoid connection failures.
Reference Sign	No	(Optional) Delimiter between the names of the referenced tables or columns. For details, see the product documentation of the corresponding database. The default value is ".