What Should I Do If a CDL Task Failed When I Perform DDL Operations?

Symptom

In a CDL data synchronization task, DDL operations other than those in DDL Operations were performed on source data. As a result, the task failed and data synchronization was interrupted.

Possible Cause

Some DDL operations are not supported by CDL.

Procedure

• Scenario 1

  If the CDL task is to synchronize data from MySQL to Kafka, stop the task on the CDL web UI and then delete the offset topic of the task. The format is Task name + _mysql_offset. After it is deleted, restart the task on the CDL web UI.

• Scenario 2

  If the DDL operations of the CDL data synchronization task are supported in DDL Operations, perform the operations by referring to this section.

• Scenario 3

  For other CDL data synchronization tasks, stop the task in error on the CDL web UI, delete the target table, create a table on the Hudi side, and restart the CDL task on the CDL web UI.

In scenarios 1 and 3, data will be lost when the MySQL offset is deleted. Data supplement is required.