From Doris
If the source link of a job is a Doris link, configure the source job parameters based on Table 1.
Type |
Parameter |
Description |
Example Value |
---|---|---|---|
Basic parameters |
Use SQL Statement |
Whether to use SQL statements to extract source data |
No |
SQL Statement |
When Use SQL Statement is set to Yes, enter an SQL statement here. CDM exports data based on the SQL statement.
NOTE:
|
select id,name from sqoop.user; |
|
Schema/Tablespace |
Name of the database to which data will be written. The schema can be automatically created. Click the icon next to the text box to select a schema or tablespace. |
schema |
|
Table Name |
Name of the table from which data will be read. Click the button next to the text box. The dialog box for selecting the table is displayed. This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. For details, see Incremental Synchronization Using the Macro Variables of Date and Time.
NOTE:
If you have configured a macro variable of date and time and schedule a CDM job through DataArts Factory of DataArts Studio, the system replaces the macro variable of date and time with (Planned start time of the data development job – Offset) rather than (Actual start time of the CDM job – Offset). |
table |
|
Advanced attributes |
Where Clause |
If you set Use SQL Statement to No, you can add a where clause to add filter criteria. |
age > 18 and age <= 60 |
Retain One Decimal Place for Date Values |
Whether to retain one decimal place for date values |
No |
|
Partition Column |
Column used to split data during data extraction to implement parallel extraction |
id |
|
Null in Partition Column |
During concurrent extraction, if the partition column does not contain null, set this parameter to No to improve performance. If you are not sure whether the partition column contains null, set this parameter to Yes to avoid data loss. |
No |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot