Updated on 2024-08-30 GMT+08:00

Suggestions

Set Proper Consumption Parameters to Avoid "File Not Found"

When the downstream consumes Hudi files too slowly, the upstream archives the Hudi files. As a result, the "File Not Found" error occurs.

  • Increase the value of read.tasks.
  • If there is a triffic limit, increase the upper limit.
  • Increase the upstream compaction, archive, and clean parameters.