ALM-50835 MemArtsStore Health Check Failed

Alarm Description

The system checks the process status, port status, and gRPC communication status between sidecar and Worker instances every 30 seconds. This alarm is generated when the system detects that the status is abnormal and the health check fails.

This alarm is cleared when the abnormal status is cleared and the health check is successful.

Alarm Attributes

Alarm Parameters

Impact on the System

The service cannot be accessed.

Possible Causes

• The process does not exist.
• The process status is abnormal.
• The port check is abnormal.
• The gRPC communication between sidecar and Worker instances fails.

Handling Procedure

Check the MemArtsStore process status.

1. On FusionInsight Manager, choose Cluster > Services > MemArtsStore > Instances.
2. Select the instances whose status is not Normal, click More, and select Restart Instance.
3. Check whether the instance status becomes normal after the restart.
   • If yes, go to Step 4.
   • If no, go to Step 5.

4. Choose O&M > Alarm > Alarms and check whether the alarm is cleared.
   • If yes, no further action is required.
   • If no, go to Step 5.

Check the port status or the communication status between sidecar and Worker instances.

5. Log in to the node where the MemArtsStore service is abnormal.
6. Go to the directory of the MemArtsStore configuration file.

   cd /opt/Bigdata/FusionInsight_MemArtsStore_8.1.2.1/1_25_StoreWorker/etc

7. Open the worker.json configuration file and find the port number in the additional information.
8. Check the port usage.

   lsof -i:Port number

   Resolve the port occupation problem.

9. On FusionInsight Manager, choose Cluster > Services > MemArtsStore > Instances.
10. Select the instances whose status is not Normal, click More, and select Restart Instance.
11. Check whether the instance status becomes normal after the restart.
    • If yes, go to Step 12.
    • If no, go to Step 13.

12. Choose O&M > Alarm > Alarms and check whether the alarm is cleared.
    • If yes, no further action is required.
    • If no, go to Step 13.

Collect fault information.

13. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
14. Expand the Service drop-down list, and select MemArtsStore for the target cluster.
15. Click the edit icon in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
16. Contact O&M engineers and send the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None