更新时间:2024-06-28 GMT+08:00
分享

单表并发控制配置

参数

描述

默认值

hoodie.write.lock.provider

指定lock provider,不建议使用默认值,使用org.apache.hudi.hive.HiveMetastoreBasedLockProvider

org.apache.hudi.client.transaction.lock.ZookeeperBasedLockProvider

hoodie.write.lock.hivemetastore.database

Hive的database

hoodie.write.lock.hivemetastore.table

Hive的table name

hoodie.write.lock.client.num_retries

重试次数

10

hoodie.write.lock.client.wait_time_ms_between_retry

重试间隔

10000

hoodie.write.lock.conflict.resolution.strategy

lock provider类,必须是ConflictResolutionStrategy的子类

org.apache.hudi.client.transaction.SimpleConcurrentFileWritesConflictResolutionStrategy

hoodie.write.lock.zookeeper.base_path

存放ZNodes的路径,同一张表的并发写入需配置一致

hoodie.write.lock.zookeeper.lock_key

ZNode的名称,建议与Hudi表名相同

hoodie.write.lock.zookeeper.connection_timeout_ms

zk连接超时时间

15000

hoodie.write.lock.zookeeper.port

zk端口号

hoodie.write.lock.zookeeper.url

zk的url

hoodie.write.lock.zookeeper.session_timeout_ms

zk的session过期时间

60000

相关文档