Help Center/
ModelArts/
Troubleshooting/
Training Jobs/
Service Code Issues/
Error Message "pandas.errors.ParserError: Error tokenizing data. C error: Expected .* fields" Is Displayed in Logs
Updated on 2025-06-06 GMT+08:00
Error Message "pandas.errors.ParserError: Error tokenizing data. C error: Expected .* fields" Is Displayed in Logs
Symptom
When pandas is used to read CSV data, the following error is displayed in logs, and the training job failed:
pandas.errors.ParserError: Error tokenizing data. C error: Expected 4 field
Possible Causes
The number of columns in each row of the CSV file is different.
Solution
Use either of the following methods to resolve this issue:
- Check the CSV file and delete the lines with extra columns.
- Run the following commands to ignore the lines with extra columns:
import pandas as pd pd.read_csv(filePath,error_bad_lines=False)
Summary and Suggestions
Before creating a training job, use the ModelArts development environment to debug your training code and minimize migration errors.
- Use the notebook environment for online debugging. For details, see Using JupyterLab to Develop Models.
- Use a local IDE (PyCharm or VS Code) to access the cloud environment for debugging. For details, see Using a Local IDE to Develop Models.
Parent topic: Service Code Issues
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot