Single-Table Concurrent Write Configuration

hoodie.write.lock.provider

Specifies the lock provider. You are advised to set the parameter to org.apache.hudi.hive.HiveMetastoreBasedLockProvider.

org.apache.hudi.client.transaction.lock.ZookeeperBasedLockProvider

hoodie.write.lock.hivemetastore.database

Specifies the Hive database.

-

hoodie.write.lock.hivemetastore.table

Specifies the Hive table name.

-

hoodie.write.lock.client.num_retries

Specifies the retry times.

0

hoodie.write.lock.client.wait_time_ms_between_retry

Specifies the retry interval.

10000

hoodie.write.lock.conflict.resolution.strategy

Specifies the lock provider class, which must be a subclass of ConflictResolutionStrategy.

org.apache.hudi.client.transaction.SimpleConcurrentFileWritesConflictResolutionStrategy

hoodie.write.lock.zookeeper.base_path

Path for storing ZNodes. The parameter must be the same for all concurrent write configurations of the same table.

-

hoodie.write.lock.zookeeper.lock_key

ZNode name. It is recommended that the ZNode name be the same as the Hudi table name.

-

hoodie.write.lock.zookeeper.connection_timeout_ms

ZooKeeper connection timeout period.

15000

hoodie.write.lock.zookeeper.port

ZooKeeper port number.

-

hoodie.write.lock.zookeeper.url

URL of the ZooKeeper.

-

hoodie.write.lock.zookeeper.session_timeout_ms

Session expiration time of ZooKeeper.

60000