ALM-12028 Number of Processes in the D State on the Host Exceeds the Threshold (For MRS 2.x or Earlier)

Description

The system periodically checks the number of D state processes of user omm on the host every 30 seconds and compares the number with the threshold. The number of processes in the D state on the host has a default threshold. This alarm is generated when the number of processes in the D state exceeds the threshold.

This alarm is cleared when the number is less than or equal to the threshold.

Attribute

Parameters

Impact on the System

Excessive system resources are used and the service process responds slowly.

Possible Causes

The host responds slowly to I/O (disk I/O and network I/O) requests and a process is in the D state.

Procedure

1. Check the process that is in the D state.
   1. Go to the MRS cluster details page. In the alarm list on the alarm management tab page, click the row that contains the alarm. In the alarm details, view the address of the host.
   2. Log in to the node for which the alarm is generated.
   3. Run the following commands to switch the user:

      sudo su - root

      su - omm

   4. Run the following command as user omm to view the PID of the process that is in the D state:

      ps -elf | grep -v "\[thread_checkio\]" | awk 'NR!=1 {print $2, $3, $4}' | grep omm | awk -F' ' '{print $1, $3}' | grep D | awk '{print $2}'

   5. Check whether the command output is empty.
      • If yes, the service process is running properly. Then go to 1.g.
      • If no, go to 1.f.
   6. Switch to user root and run the reboot command to restart the alarm host.

      Restarting the host brings certain risks. Ensure that the service process runs properly after the restart.

   7. Wait 5 minutes and check whether the alarm is cleared.
      • If yes, no further action is required.
      • If no, go to 2.

2. Collect fault information.
   1. On MRS Manager, choose System > Export Log.
   2. Contact the O&M engineers and send the collected logs.

Reference

None