Updated on 2023-12-18 GMT+08:00

To DLI

If the destination link of a job is a DLI link, configure the destination job parameters based on Table 1.

When you use CDM to migrate data to DLI, DLI generates data files in the dli-trans* temporary OBS bucket. Therefore, you need to grant the account corresponding to the AK/SK the permissions to read and write the dli-trans* bucket and create directories. For details about how to add OBS permission policies, see Adding an OBS Bucket Policy.

Table 1 Parameter description

Parameter

Description

Example Value

Resource Queue

Resource queue to which the destination table belongs

The default queue of DLI cannot be used for migration jobs. You need to create a SQL queue in DLI.

For details about how to create a queue, see Creating a Queue.

cdm

Database Name

Name of the database to which data will be written

dli

Table Name

Name of the table to which data will be written

car_detail

Clear Data Before Import

Whether to clear data in the destination table before data import

If this parameter is set to Yes, data in the destination table will be cleared before the task is started.

No

Convert empty strings to null

If this parameter is set to Yes, an empty string is regarded as null.

No

Data Clearing Mode

This parameter is available when Clear Data Before Import is set to Yes.

TRUNCATE: deletes standard data.

INSERT_OVERWRITE: overwrites existing data with inserted data.

NOTE:

If the source link is a Kafka link and Clear Data Before Import is set to Yes, INSERT_OVERWRITE is unavailable.

TRUNCATE

Partition

This parameter is available when Clear Data Before Import is set to Yes.

When you enter partitions, data in these partitions will be cleared.

year=2020,location=sun

Adding an OBS Bucket Policy

  1. Log in to the IAM console.
  2. In the navigation pane, choose Permissions > Policies/Roles and click Create Custom Policy in the upper right corner.

    Figure 1 Creating a custom policy

  3. Enter a policy name and set Policy Content.

    Figure 2 Configuring the policy

  4. Enter the policy description and click OK.