Help Center/ Cloud Data Migration/ User Guide/ Creating a Job in a CDM Cluster/ Configuring CDM Source Job Parameters/ From MRS Hudi
Updated on 2026-07-29 GMT+08:00
View PDF
Share

From MRS Hudi

If the source link of a job is an MRS Hudi link, configure the source job parameters based on Table 1.

Table 1 Parameter description

Category

Parameter

Description

Example Value

Basic parameters

Source Link Name

MRS Hudi link

hudi_from_cdm

Database Name

Database name. Click the icon next to the text box. The dialog box for selecting the database is displayed.

default

Table Name

Hudi table name. Click the icon next to the text box. The dialog box for selecting the table is displayed.

You can set a macro variable of date and time, and a path name can contain multiple macro variables. You can use macro variables of date and time in a scheduled job to synchronize incremental data periodically. For details, see Using Macro Variables of Date and Time.

NOTE:

If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job – Offset) rather than (Actual start time of the CDM job – Offset).

TBL_E

Run Queue

This parameter is available only when the connection type is API.

It is the value of the request parameter --queue, which determines the queue to which a Hive task is submitted for execution.

default

Advanced attributes

SQL Execution Parameters

When compiling Hudi, you can configure Spark parameters. The parameters you enter will be added to the request body as --conf parameters. Spark Driver and Executor parameters are also supported.

--driver-memory=2G,--executor-memory=2G,--driver-cores=1,--executor-cores=1,--num-executors=2

Where Clause

This parameter indicates the where clause to be extracted. If this parameter is not set, the entire table is extracted. If the table to be migrated does not contain the fields specified by the where clause, the migration will fail.

You can set a macro variable of date and time to extract the data generated on a specific date. For details, see Incremental Migration of Relational Databases.

NOTE:

If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job – Offset) rather than (Actual start time of the CDM job – Offset).

age > 18 and age <= 60