Configuration of Hive Table Synchronization
Parameter |
Description |
Default Value |
---|---|---|
hoodie.datasource.hive_sync.enable |
Specifies whether to synchronize the Hudi table information to Hive MetaStore.
CAUTION:
You are advised to set this parameter to true to use Hive to manage the Hudi table. |
false |
hoodie.datasource.hive_sync.database |
Specifies the name of the database to be synchronized to Hive. |
default |
hoodie.datasource.hive_sync.table |
Specifies the name of the table to be synchronized to Hive. You are advised to set this parameter to the value of hoodie.datasource.write.table.name. |
None |
hoodie.datasource.hive_sync.username |
Specifies the username used for Hive synchronization. |
hive |
hoodie.datasource.hive_sync.password |
Specifies the password used for Hive synchronization. |
hive |
hoodie.datasource.hive_sync.jdbcurl |
Specifies the Hive JDBC URL for connection. |
jdbc:hive2://localhost:10000 |
hoodie.datasource.hive_sync.use_jdbc |
Specifies whether to use Hive JDBC to connect to Hive for the Hudi table information synchronization. You are advised to set this parameter to false, which indicates that the JDBC connection configuration is invalid. |
true |
hoodie.datasource.hive_sync.partition_fields |
Specifies the Hive partition columns. |
` ` |
hoodie.datasource.hive_sync.partition_extractor_class |
Specifies the class used to extract Hudi partition field values and convert them into Hive partition columns. |
org.apache.hudi.hive.SlashEncodedDayPartitionValueExtractor |
hoodie.datasource.hive_sync.support_timestamp |
If the Hudi table contains a field of the timestamp type, set this parameter to true to synchronize the timestamp type to the Hive metadata. The default value is false, indicating that the timestamp type is converted to bigint during synchronization by default. In this case, an error may occur when you query a Hudi table that contains a field of the timestamp type using SQL statements. |
true |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot