Help Center/Cloud Data Migration/User Guide/Creating a Job in a CDM Cluster/Configuring CDM Source Job Parameters/From DLI
Updated on 2025-12-02 GMT+08:00
View PDF

From DLI

If the source link of a job is a DLI link, configure the source job parameters based on Table 1.

The lifecycle of a DLI bucket is two days by default. If a job runs for more than 48 hours, some data may be lost.

Table 1 Parameter description

Parameter

Description

Example Value

Resource Queue

Resource queue to which the destination table belongs

The default queue of DLI cannot be used for migration jobs. You need to create a SQL queue in DLI.

cdm

Database Name

Name of the database to which data will be written

dli

Table Name

Name of the table to which data will be written

car_detail

Partition

Partition information

Data can be read from DLI non-partitioned tables, or jobs in a partition can run concurrently only when the following conditions are met:

  • The number of concurrent jobs is greater than 1.
  • More than 64 MB data is exported from DLI.
  • An OBS bucket has been configured for the DLI queue.
  • ['year=2020']
  • ['year=2020,location=sun']
  • ['year=2020,location=sun', 'year=2021,location=earth']
  • Read data of the previous day:

    If the current date is 2024-07-16, ['DS=${dateformat(yyyy-MM-dd, -1, DAY)}'] indicates that the data whose DS partition value is 2024-07-15 is extracted.

    For details about other scenarios, see Using Macro Variables of Date and Time.