Updated on 2025-04-21 GMT+08:00

Hudi Lock Configuration

When submitting a Spark JAR job, you need to manually configure the Hudi lock.

When using the metadata service hosted by DLI, the Hudi lock must be enabled, and the implementation class of the Hudi lock provided by DLI must be configured.

Parameter

Value

hoodie.write.lock.provider

com.huawei.luxor.hudi.util.DliCatalogBasedLockProvider

Similarly, when using the metadata service provided by LakeFormation, the implementation class of the Hudi lock provided by LakeFormation must be configured and used.

Parameter

Value

hoodie.write.lock.provider

org.apache.hudi.lakeformation.LakeCatMetastoreBasedLockProvider

  • Disabling the Hudi lock or using other lock implementation classes poses a risk of data loss or anomalies.
  • Under any circumstances, DLI is not responsible for any form of loss or damage, direct or indirect, caused by disabling the Hudi lock or using lock implementation classes that do not match the metadata service. This includes but is not limited to, loss of business profits, service interruption, data loss, or other financial losses.