更新时间:2025-01-06 GMT+08:00
Doris集群导入数据频繁报错E-235
问题现象
集群频繁报错E-235,报错信息如下:
PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO crowd.crowd_user_bitmap SELECT 136, ?, to_bitmap(t1.tyc_user_id_new) FROM dim.dim_user_comparison as t1 RIGHT JOIN dwd.dwd_user_register_details as t2 ON t2.tyc_user_id = t1.tyc_user_id WHERE (unix_timestamp(current_timestamp()) - unix_timestamp(t2.update_time) <= 40) AND (((t2.vip_to_time > from_unixtime(1732982399))))]; SQL state [HY000]; error code [1105]; errCode = 2, detailMessage = (10.x.x.x)[INTERNAL_ERROR][INTERNAL_ERROR]close wait failed coz rpc error. [INTERNAL_ERROR]tablet error: [E-235], host: 10.x.x.x, host: 10.x.x.x; nested exception is java.sql.SQLException: errCode = 2, detailMessage = (10.x.x.74)[INTERNAL_ERROR][INTERNAL_ERROR]close wait failed coz rpc error. [INTERNAL_ERROR]tablet error: [E-235], host: 10.x.x.x, host: 10.x.x.x
分析原因
用户导入数据速度过快,频繁小批量数据导入会产生过多数据版本,超过max_tablet_version_num设置的值,则报错E-235。
处理办法
- 通过报错信息查看报错表。例如:tablet writer write failed, tablet_id=27xxx2, txn_id=285xxx20, err=[-235] 。
show table tablet_id;
- 查看表各副本的情况。结果中versionCount字段表示版本数量,如果副本版本过多,则需要降低导入数据的频率或者停止导入。
show proc "/dbs/...";
此处命令使用步骤1运行结果DetailCmd字段对应的值。
父主题: 数据导入