Help Center/ MapReduce Service/ Component Operation Guide (LTS) (Ankara Region)/ Using CDL/ CDL FAQs/ Why Are There Too Many Topic Partitions Corresponding to the CDL Synchronization Task Names?
Updated on 2024-11-29 GMT+08:00
View PDF
Share

Why Are There Too Many Topic Partitions Corresponding to the CDL Synchronization Task Names?

Symptom

After a CDL task is started, the value of Partitions Num of the CDL task name is too large in Topic List on the Kafka web UI.

Possible Causes

Topic Table Mapping is configured for CDL tasks, but the WhiteList parameter is not configured. CDL tasks of the schema configured for the CDL task have too many tables that are not synchronized. As a result, too many partitions are created for CDL task names.

Procedure

  1. Log in to FusionInsight Manager and choose Cluster > Services > CDL. Click the hyperlink next to CDLService UI to access the CDLService web UI. On the data synchronization job list page, locate the row that contains the target job and choose More > Stop. After the job is stopped, choose More > Edit.
  2. Change the value of WhiteList of the Source to the configured number of Topic Table Mapping tables and click Save.
  3. Log in to FusionInsight Manager, choose Cluster > Services > Kafka, and click the hyperlink on the right of Kafka UI to go to the Kafka web UI. On the Topics tab, search for the CDL task name and click Action > Delete in the Operation column.
  4. On the data synchronization job list page of CDL web UI, locate the row containing the target job and click Start to restart the job.
Parent topic: CDL FAQs