单表并发写配置
参数 |
描述 |
默认值 |
---|---|---|
hoodie.write.lock.provider |
指定lock provider,不建议使用默认值,使用org.apache.hudi.hive.HiveMetastoreBasedLockProvider |
org.apache.hudi.client.transaction.lock.ZookeeperBasedLockProvider |
hoodie.write.lock.hivemetastore.database |
Hive的database |
- |
hoodie.write.lock.hivemetastore.table |
Hive的table name |
- |
hoodie.write.lock.client.num_retries |
重试次数 |
0 |
hoodie.write.lock.client.wait_time_ms_between_retry |
重试间隔 |
10000 |
hoodie.write.lock.conflict.resolution.strategy |
lock provider类,必须是ConflictResolutionStrategy的子类 |
org.apache.hudi.client.transaction.SimpleConcurrentFileWritesConflictResolutionStrategy |
hoodie.write.lock.zookeeper.base_path |
存放ZNodes的路径,同一张表的并发写入需配置一致 |
- |
hoodie.write.lock.zookeeper.lock_key |
ZNode的名称,建议与Hudi表名相同 |
- |
hoodie.write.lock.zookeeper.connection_timeout_ms |
zk连接超时时间 |
15000 |
hoodie.write.lock.zookeeper.port |
zk端口号 |
- |
hoodie.write.lock.zookeeper.url |
zk的url |
- |
hoodie.write.lock.zookeeper.session_timeout_ms |
zk的session过期时间 |
60000 |