From Hive

If the source link of a job is the Link to Hive, configure the source job parameters based on Table 1.

Table 1 Parameter description

Parameter

Description

Example Value

Database Name

Database name. Click the icon next to the text box. The dialog box for selecting the database is displayed.

default

Table Name

Hive table name. Click the icon next to the text box. The dialog box for selecting the table is displayed.

This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. For details, see Incremental Synchronization Using the Macro Variables of Date and Time.

TBL_E

Partition Filter Criteria

This parameter is displayed when you click Show Advanced Attributes.

You can configure multiple values (separated by spaces) or a range. The time macro function is supported.

  • Single/Multi-value filtering:

    "${dateformat(yyyyMMdd, -1, DAY)} ${dateformat(yyyyMMdd)}"

  • Filter by range:

    "${value} >= ${dateformat(yyyyMMdd, -7, DAY)} && ${value} < ${dateformat(yyyyMMdd)}"

If the data source is Hive, CDM will automatically partition data using the Hive data partitioning file.