Help Center/ ROMA Connect/ Troubleshooting/ Common Data Integration Tasks/ Data May Be Lost When Incremental Data Collection Is Performed from the Source MySQL on an Hourly Basis

Updated on 2022-02-21 GMT+08:00

View PDF

Data May Be Lost When Incremental Data Collection Is Performed from the Source MySQL on an Hourly Basis

Cause Analysis

The source database uses createtime to record the time when data is inserted and uses updatetime to record the time when data is updated. During task creation, Timestamp is set to updatetime. However, the value of updatetime is earlier than that of createtime in the source database. When the task is executed, the time specified updatetime is not within the incremental collection period. As a result, some data cannot be collected.

Solution

Change the value of updatetime in the source database or use createtime as the timestamp field during task creation.

Parent topic: Common Data Integration Tasks

Previous topic: Error Message "Illegal mix of collations for operation 'UNION'" Is Displayed at the Source Database During MySQL-to-MySQL Data Integration

Next topic: Error Message "401 unauthorized" Is Displayed at the Source During API-to-MySQL Data Integration

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.