Write Configuration
Parameter |
Description |
Default Value |
---|---|---|
hoodie.datasource.write.table.name |
Specifies the name of the Hudi table to be written. |
None |
hoodie.datasource.write.operation |
Specifies the operation type of writing the Hudi table. Currently, upsert, delete, insert, and bulk_insert are supported.
|
upsert |
hoodie.datasource.write.table.type |
Specifies the Hudi table type. Once the table type is specified, this parameter cannot be modified. The value can be MERGE_ON_READ. |
COPY_ON_WRITE |
hoodie.datasource.write.precombine.field |
Merges and reduplicates rows with the same key before write. |
ts |
hoodie.datasource.write.payload.class |
Specifies the class used to merge the records to be updated and the updated records during update. This parameter can be customized. You can compile it yourself to implement your merge logic. |
org.apache.hudi.common.model.Defaulthoodierecordpayload |
hoodie.datasource.write.recordkey.field |
Specifies the primary key of the Hudi table. The Hudi table must have a unique primary key. |
uuid |
hoodie.datasource.write.partitionpath.field |
Specifies the partition key. This parameter is used together with hoodie.datasource.write.keygenerator.class to meet the requirements of different partition scenarios. |
None |
hoodie.datasource.write.hive_style_partitioning |
Specifies whether the partition mode is the same as that of Hive. You are advised to set this parameter to true. |
true |
hoodie.datasource.write.keygenerator.class |
Generates the primary key and partition mode when used together with hoodie.datasource.write.partitionpath.field and hoodie.datasource.write.recordkey.field.
NOTE:
If the value of this parameter is different from that saved in the table, a message is displayed, indicating that the value must be the same. |
org.apache.hudi.keygen.ComplexKeyGenerator |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot