How Do I Use pipeline.operator-chaining to Locate Problems in Flink?

Symptom

During Flink running, operators are chained together to form a task to reduce the network overhead. However, in the case of back pressure, inaccurate data, or other issues, it is difficult to quickly identify the faulty operator.

Solution

Set pipeline.operator-chaining to false to break the operator chain and check which operator is faulty.

pipeline.operator-chaining=false

Case Description

Take a job as an example, where the second task is busy. However, since the operators are chained together, it is difficult to determine which operator is faulty.

To break the operator chain, you can set pipeline.operator-chaining to false. It is found that the map operator is faulty, and further analysis can be performed to locate the cause.