How Do I Limit the Size of Application Diagnostic Messages Stored in the ZKstore?

Question

How do I limit the size of application diagnostic messages stored in the ZKstore?

Answer

In some cases, it has been observed that diagnostic messages may grow infinitely. Because diagnostic messages are stored in the ZKstore, it is not recommended that you allow diagnostic messages to grow indefinitely. Therefore, a property parameter is needed to set the maximum size of the diagnostic message.

To set the yarn.app.attempt.diagnostics.limit.kc parameter, perform the following steps:

1. Log in to FusionInsight Manager.

   For details about how to log in to FusionInsight Manager, see Accessing MRS FusionInsight Manager.

2. Choose Cluster > Services > Yarn > Configurations > All Configurations.
3. Search for and modify the following parameter.

   Table 1 Parameter description

   Parameter	Description	Default Value
   yarn.app.attempt.diagnostics.limit.kc	Maximum size of the diagnostics message of an application attempt. It is measured in kilobytes (KB) (number of characters x 1024). When ZooKeeper is used to store the behavior status of applications, the size of diagnosis messages needs to be limited to prevent Yarn from overloading ZooKeeper. If yarn.resourcemanager.state-store.max-completed-applications is set to a large value, you need to decrease the value of this property to limit the total size of stored data.	64

4. Save the settings. Restart the expired service or instance for the configuration to take effect.