Updated on 2023-01-11 GMT+08:00

Configuration of Hive Table Synchronization

Parameter

Description

Default Value

hoodie.datasource.hive_sync.enable

Specifies whether to synchronize the Hudi table information to Hive MetaStore.

CAUTION:

You are advised to set this parameter to true to use Hive to manage the Hudi table.

false

hoodie.datasource.hive_sync.database

Specifies the name of the database to be synchronized to Hive.

default

hoodie.datasource.hive_sync.table

Specifies the name of the table to be synchronized to Hive. You are advised to set this parameter to the value of hoodie.datasource.write.table.name.

None

hoodie.datasource.hive_sync.username

Specifies the username used for Hive synchronization.

hive

hoodie.datasource.hive_sync.password

Specifies the password used for Hive synchronization.

hive

hoodie.datasource.hive_sync.jdbcurl

Specifies the Hive JDBC URL for connection.

jdbc:hive2://localhost:10000

hoodie.datasource.hive_sync.use_jdbc

Specifies whether to use Hive JDBC to connect to Hive for the Hudi table information synchronization. You are advised to set this parameter to false, which indicates that the JDBC connection configuration is invalid.

true

hoodie.datasource.hive_sync.partition_fields

Specifies the Hive partition columns.

""

hoodie.datasource.hive_sync.partition_extractor_class

Specifies the class used to extract Hudi partition field values and convert them into Hive partition columns.

org.apache.hudi.hive.SlashEncodedDayPartitionValueExtractor

hoodie.datasource.hive_sync.support_timestamp

If the Hudi table contains a field of the timestamp type, set this parameter to true to synchronize the timestamp type to the Hive metadata. The default value is false, indicating that the timestamp type is converted to bigint during synchronization by default. In this case, an error may occur when you query a Hudi table that contains a field of the timestamp type using SQL statements.

true