ALM-12027 Host PID Usage Exceeds the Threshold

Alarm Description

The system checks the PID usage every 30 seconds and compares the actual PID usage with the default threshold. This alarm is generated when the PID usage exceeds the threshold.

When the trigger count is 1, this alarm is cleared when the PID usage is less than or equal to the threshold. When the trigger count is greater than 1, this alarm is cleared when the PID usage is less than or equal to 90% of the threshold.

Alarm Attributes

Alarm Parameters

Impact on the System

When the host PID usage is too high, PIDs cannot be allocated to new service processes. As a result, jobs may fail to run.

Possible Causes

Too many processes are running on the node. You need to increase the value of pid_max.

Handling Procedure

Increase the value of pid_max.

1. Log in to MRS Manager. In the real-time alarm list, locate the row that contains the alarm and click to obtain the IP address of the host for which the alarm is generated.

   For details about how to log in to FusionInsight Manager, see Accessing MRS Manager.

2. Log in to the host for which the alarm is generated as user root.
3. Run the following command to check the maximum PID (pid_max) in the system:

   cat /proc/sys/kernel/pid_max

4. If the PID usage exceeds the threshold, run the following command to edit the /etc/sysctl.conf file:

   vi /etc/sysctl.conf

   Increase the value of kernel.pid_max to twice the value obtained in Step 3. If the parameter is not contained, add it to the end of the file.

   For example, change the parameter value to kernel.pid_max=65536 and run the following command to make the parameter take effect immediately:

   sysctl -p

   

   The maximum value of kernel.pid_max can be set to:

   • 32-bit OS: 32768
   • 64-bit OS: 4194304 (22nd power of 2)

5. Wait 5 minutes and check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to Step 6.

Collect fault information.

6. On MRS Manager of the cluster, choose O&M. In the navigation pane on the left, choose Log > Download.
7. In the Service area, select all services and click OK.
8. Click in the upper right corner, set Start Date and End Date for log collection to 30 minutes before and after the alarm generation time, respectively, and click Download.
9. Send the collected fault logs to O&M personnel for help.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None