On this page

Show all

Help Center/ MapReduce Service/ Component Operation Guide (Normal)/ Using YARN/ Common Issues About Yarn/ How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?

How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?

Updated on 2022-09-15 GMT+08:00

Question

How do I limit the size of application diagnostic messages stored in the ZKstore?

Answer

In some cases, it has been observed that diagnostic messages may grow infinitely. Because diagnostic messages are stored in the ZKstore, it is not recommended that you allow diagnostic messages to grow indefinitely. Therefore, a property parameter is needed to set the maximum size of the diagnostic message.

If you need to set yarn.app.attempt.diagnostics.limit.kc, go to the All Configurations page by referring to Modifying Cluster Service Configuration Parameters and search for the following parameters in the search box:

Table 1 Parameter description

Parameter

Description

Default Value

yarn.app.attempt.diagnostics.limit.kc

Data size of the diagnosis message for each application connection, in kilobytes (number of characters x 1,024). When ZooKeeper is used to store the behavior status of applications, the size of diagnosis messages needs to be limited to prevent Yarn from overloading ZooKeeper. If yarn.resourcemanager.state-store.max-completed-applications is set to a large value, you need to decrease the value of this property to limit the total size of stored data.

64

Feedback

Feedback

Feedback

0/500

Selected Content

Submit selected content with the feedback