Configuring YARN Memory Usage Checks
Scenario
If you cannot estimate the exact memory requirements of a submitted application, you can configure the server to enable or disable memory usage checks.
If memory checks are disabled, containers can consume system memory until the node runs out of resources. If memory checks are enabled and a container exceeds its allocated limit, YARN will automatically terminate that container.
Configuration Description
Go to the All Configurations page of YARN by referring to Modifying Cluster Service Configuration Parameters and enter a parameter name in the search box.
| Parameter | Description | Default Value |
|---|---|---|
| yarn.nodemanager.vmem-check-enabled | Whether to enable virtual memory usage detection. If the memory used by a task exceeds the allocated memory size, the task is forcibly stopped.
| true |
| yarn.nodemanager.pmem-check-enabled | Whether to enable physical memory usage detection. If the memory used by a task exceeds the allocated memory size, the task is forcibly stopped.
| true |
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot