ALM-18011 Memory of Pending Yarn Tasks Exceeds the Threshold (For MRS 2.x or Earlier)
Description
The system checks the memory of pending Yarn tasks every 30 seconds and compares the memory with the threshold. This alarm is generated when the memory of pending tasks exceeds the threshold.
You can change the threshold by choosing System > Configure Alarm Threshold > Service > Yarn > Queue Root Pending Memory > Queue Root Pending Memory on MRS Manager.
This alarm is cleared when the memory of pending tasks is less than or equal to the threshold.
Attribute
Alarm ID |
Alarm Severity |
Automatically Cleared |
---|---|---|
18011 |
Major |
Yes |
Parameters
Parameter |
Description |
---|---|
ServiceName |
Specifies the service for which the alarm is generated. |
RoleName |
Specifies the role for which the alarm is generated. |
HostName |
Specifies the host for which the alarm is generated. |
Trigger Condition |
Specifies the threshold for triggering the alarm. |
Impact on the System
Tasks may be stacked and cannot be processed in a timely manner.
Possible Causes
The computing capability of the cluster is lower than the task submission rate. As a result, the task cannot be processed in a timely manner after being submitted.
Procedure
- Check the usage of memory and vCores on the Yarn page.
Check whether the values of Memory Used|Memory Total and VCores Used|VCores Total on the native Yarn page reach or approach the maximum values.
- Check the number of submitted tasks.
Check whether the running tasks are submitted at a normal frequency.
- Scale out the cluster.
The scale-out is based on the site requirements. For details, see .
- After the scale-out is completed, check whether the alarm is cleared.
- If yes, no further action is required.
- If no, go to 5.
- Collect fault information.
- On MRS Manager, choose .
- Contact the O&M engineers and send the collected logs.
Reference
None
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.