Help Center> Cloud Data Migration> User Guide> Job Management> Source Job Parameters> From DIS
View PDF

From DIS

Currently, data can only be exported from DIS to CSS, Apache Kafka, or DMS Kafka.

The data in the message body is a record in CSV format that supports multiple delimiters. Messages cannot be parsed in binary or other formats.

If the source link of a job is the Link to DIS, configure the source job parameters based on Table 1.

Table 1 Parameter description

Parameter

Description

Example Value

DIS Stream

DIS stream name

dis

Offset
Initial offset when data is pulled from DIS
  • Latest: Maximum offset, indicating that the latest data will be extracted.
  • From last stop: Data read will start from which the last read ended.
  • Earliest: Minimum offset, indicating that the earliest data will be extracted.

Latest

Permanent Running

Whether a job runs permanently. If a job is set to run for a long time, the job will fail if the DIS system is interrupted.

Yes

DIS Partition ID

ID of the DIS partition. You can enter multiple partition IDs separated by commas (,).

0,1,2

Data Format

Format used for parsing data. The options are as follows:

  • Binary: Data is transferred directly. It is not converted to another format. This setting is suitable for file migration.
  • CSV: Source data will be migrated after being converted in CSV format.

Binary

Field Delimiter

The default value is space. To set the Tab key as the delimiter, set this parameter to \t.

,

Max. Poll Records

(Optional) Maximum number of records per poll

100

Application Name

Unique identifier of the consumer application to be used. If no application exists, CDM creates one automatically.

cdm
Parent topic: Source Job Parameters