Help Center/ ModelArts/ Troubleshooting/ Training Jobs/ Memory Limit Issues/ Size of the Log File Has Reached the Limit
Updated on 2024-06-11 GMT+08:00

Size of the Log File Has Reached the Limit

Symptom

An error occurs during the running of a ModelArts training job, indicating that the size of the log file has reached the limit.

modelarts-pope: log length overflow(max:1073741824; already: 107341771; new:90), process will continue running silently

Possible Cause

Error information indicates that the size of the log file has reached the limit. After this error occurs, the volume of logs does not increase and the background continues to run.

Solution

Reduce unnecessary log output from the boot file.