How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?
Question
How do I limit the size of application diagnostic messages stored in the ZKstore?
Answer
In some cases, it has been observed that diagnostic messages may grow infinitely. Because diagnostic messages are stored in the ZKstore, it is not recommended that you allow diagnostic messages to grow indefinitely. Therefore, a property parameter is needed to set the maximum size of the diagnostic message.
To set the yarn.app.attempt.diagnostics.limit.kc parameter, perform the following steps:
- Log in to FusionInsight Manager.
For details about how to log in to FusionInsight Manager, see Accessing MRS FusionInsight Manager.
- Choose Cluster > Services > Yarn > Configurations > All Configurations.
- Search for and modify the following parameter.
Table 1 Parameter description Parameter
Description
Default Value
yarn.app.attempt.diagnostics.limit.kc
Maximum size of the diagnostics message of an application attempt.
It is measured in kilobytes (KB) (number of characters x 1024).
When ZooKeeper is used to store the behavior status of applications, the size of diagnosis messages needs to be limited to prevent Yarn from overloading ZooKeeper. If yarn.resourcemanager.state-store.max-completed-applications is set to a large value, you need to decrease the value of this property to limit the total size of stored data.
64
- Save the settings. Restart the expired service or instance for the configuration to take effect.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot