Help Center/ DataArts Studio/ User Guide/ DataArts Migration/ Creating a Link in a CDM Cluster/ Configuring Link Parameters/ OBS Link Parameters
Updated on 2024-12-18 GMT+08:00
View PDF
Share

OBS Link Parameters

When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.

  • If the CDM cluster and OBS bucket are not in the same region, the CDM cluster cannot access the OBS bucket.
  • Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.
When connecting CDM to OBS, configure the parameters as described in Table 1.
Table 1 Parameter description

Parameter

Description

Example Value

Name

Link name, which should be defined based on the data source type, so it is easier to remember what the link is for

obs_link

OBS Endpoint

An endpoint is the request address for calling an API. Endpoints vary depending on services and regions. You can obtain the OBS bucket endpoint by either of the following means:

To obtain the endpoint of an OBS bucket, go to the OBS console and click the bucket name to go to its details page.

NOTE:
  • If the CDM cluster and OBS bucket are not in the same region, the CDM cluster cannot access the OBS bucket.
  • Do not change the password or user when the job is running. If you do so, the password will not take effect immediately and the job will fail.

obs.myregion.mycloud.com

Port

Data transmission port. The HTTPS port number is 443 and the HTTP port number is 80.

443

OBS Bucket Type

Select a value from the drop-down list, generally, Object Storage.

Object Storage

AK

AK and SK are used to log in to the OBS server.

You need to create an access key for the current account and obtain an AK/SK pair.

To obtain an access key, perform the following steps:
  1. Log in to the management console, move the cursor to the username in the upper right corner, and select My Credentials from the drop-down list.
  2. On the My Credentials page, choose Access Keys, and click Create Access Key. See Figure 1.
    Figure 1 Clicking Create Access Key
  3. Click OK and save the access key file as prompted. The access key file will be saved to your browser's configured download location. Open the credentials.csv file to view Access Key Id and Secret Access Key.
    NOTE:
    • Only two access keys can be added for each user.
    • To ensure access key security, the access key is automatically downloaded only when it is generated for the first time and cannot be obtained from the management console later. Keep them properly.

-

SK

-

Link Attributes

(Optional) Displayed when you click Show Advanced Attributes.

You can click Add to add custom attributes for the link.

Only connectionTimeout, socketTimeout, and idleConnectionTime are supported.

The following are some examples:

  • socketTimeout: timeout interval for data transmission at the socket layer, in milliseconds
  • connectionTimeout: timeout interval for establishing an HTTP/HTTPS connection, in milliseconds

-