What Should I Do If CSV Data Fails to Be Inserted into a MySQL Database?

Symptom

The job fails to be executed, and message "invalid utf-8 character string" is displayed.

Fault Analysis

According to the error information, dirty data exists in the user data and the types of some fields do not match.

Solution

1. Check the sqoop logs in the background. The error may be caused by the incorrect data type or format of the source. (You can obtain the job logs from the customer or export all logs on the console.)

   

2. Analyze the source data type. It is found that dirty data exists and the source data type is incorrect.
3. Configure dirty data dump on the CDM console and rerun the job. The job is successfully executed, and the dirty data type in the OBS bucket is incorrect.