Help Center/ MapReduce Service/ Component Operation Guide (LTS)/ Using Doris/ Common Issues About Doris/ What Should I Do If an Error Message Is Displayed When Broker Load Is Used to Import Data?
Updated on 2024-10-25 GMT+08:00
View PDF
Share

What Should I Do If an Error Message Is Displayed When Broker Load Is Used to Import Data?

Symptom

When Broker Load is used to import data, the error message "failed to send batch" or "TabletWriter add batch with unknown id" is displayed.

Cause Analysis

The task execution times out due to a large number of concurrent requests or a large amount of data.

Procedure

  1. Log in to the MySQL client and run the following command to increase the value of query_timeout. The default value is 300 seconds.

    SET GLOBAL query_timeout = xxx;

  2. Log in to FusionInsight Manager, choose Cluster > Services > Doris and click Configurations > All Configurations. Select BE (Role) > Customization, and add the custom parameter streaming_load_rpc_max_alive_time_sec. The default value is 1200 seconds. You need to increase the value of this parameter and restart the BE instance whose configuration has expired.