ALM-12007 Process Fault

Description

This alarm is generated when the process health check module detects that the process connection status is Bad for three consecutive times. The process health check module checks the process status every 5 seconds.

This alarm is cleared when the process can be connected.

Attribute

Parameters

Impact on the System

The service provided by the process is unavailable.

Possible Causes

• The instance process is abnormal.
• The disk space is insufficient.

If a large number of process fault alarms exist in a time segment, files in the installation directory may be deleted mistakenly or permission on the directory may be modified.

Procedure

Check whether the instance process is abnormal.

1. In the FusionInsight Manager portal, click O&M > Alarm > Alarms, click in the row where the alarm is located , and click the host name to view the host address for which the alarm is generated
2. On the Alarms page, check whether the ALM-12006 Node Fault is generated.
   • If yes, go to 3.
   • If no, go to 4.

3. Handle the alarm according to ALM-12006 Node Fault.
4. Log in to the host for which the alarm is generated as user root. Check whether the installation directory user, user group, and permission of the alarm role are correct. The user, user group, and the permission must be omm:ficommon 750.

   For example, the NameNode installation directory is ${BIGDATA_HOME}/FusionInsight_Current/1_8_NameNode/etc.

   • If yes, go to 6.
   • If no, go to 5.

5. Run the following command to set the permission to 750 and User:Group to omm:ficommon:

   chmod 750 <folder_name>

   chown omm:ficommon <folder_name>

6. Wait for 5 minutes. In the alarm list, check whether ALM-12007 Process Fault is cleared.
   • If yes, no further action is required.
   • If no, go to 7.

7. Log in to the active OMS node as user root and run the following command to view the configurations.xml file. In the preceding command, "Service name" is the service name queried in 1.

   vi $BIGDATA_HOME/components/current/Service name/configurations.xml

   Search for the keyword healthMonitor.properties, find the health check configuration item corresponding to the alarm reporting instance, and record the interface or script path specified by monitor.info, as shown in the following figure.

   Check the logs recorded in the interface or script and rectify the fault.

   

8. Wait for 5 minutes. In the alarm list, check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to 9.

Check whether disk space is sufficient.

9. On the FusionInsight Manager, check whether the alarm list contains ALM-12017 Insufficient Disk Capacity.
   • If yes, go to 10.
   • If no, go to 13.

10. Rectify the fault by following the steps provided in ALM-12017 Insufficient Disk Capacity.
11. Wait for 5 minutes. In the alarm list, check whether ALM-12017 Insufficient Disk Capacity is cleared.
    • If yes, go to 12.
    • If no, go to 13.

12. Wait for 5 minutes. In the alarm list, check whether the alarm is cleared.
    • If yes, no further action is required.
    • If no, go to 13.

Collect fault information.

13. On the FusionInsight Manager, choose O&M > Log > Download.
14. According to the service name obtained in 1, select the component and NodeAgent from the Service and click OK.
15. Click in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
16. Contact the O&M personnel and send the collected log information.

Alarm Clearing

After the fault is rectified, the system automatically clears this alarm.

Related Information

None