Why Mounted Directory for Container is Not Cleared After the Completion of the Job While Using CGroups?

This happens due to the deletion timeout. Some task takes more time to complete than the deletion time.

To avoid this scenario, you can go to the All Configurations page of Yarn by referring to Modifying Cluster Service Configuration Parameters. Search for the yarn.nodemanager.linux-container-executor.cgroups.delete-timeout-ms configuration item in the search box to change the deletion interval. The value is in milliseconds.