Why Are Local Logs Not Deleted After YARN Is Restarted?
Question
If Yarn is restarted in either of the following scenarios, local logs will not be deleted as scheduled and will be retained permanently:
- When Yarn is restarted during task running, local logs are not deleted.
- When the task is complete and logs fail to be collected, restart Yarn before the logs are cleared as scheduled. In this case, local logs are not deleted.
Answer
NodeManager has a restart recovery mechanism. For details, visit the following:
Go to the All Configurations tab page of YARN by referring to Modifying Cluster Service Configuration Parameters. Set yarn.nodemanager.recovery.enabled of NodeManager to true to make the configuration take effect. The default value is true. In this way, redundant local logs are periodically deleted when the YARN is restarted.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
