Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-45736 Guardian Service Unavailable
Updated on 2024-09-23 GMT+08:00
View PDF
Share

ALM-45736 Guardian Service Unavailable

This section applies only to MRS 3.1.5 or later.

Alarm Description

The alarm module checks the Guardian service status every 60 seconds. This alarm is generated if Guardian is unavailable.

This alarm is cleared after Guardian recovers.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

45736

Critical

Yes

Alarm Parameters

Parameter

Description

Source

Specifies the cluster for which the alarm was generated.

ServiceName

Specifies the service for which the alarm was generated.

RoleName

Specifies the role for which the alarm was generated.

HostName

Specifies the host for which the alarm was generated.

Impact on the System

Guardian cannot work properly, and OBS cannot be accessed.

Possible Causes

  • The HDFS service on which the Guardian service depends is abnormal.
  • The TokenServer role instance is abnormal.

Handling Procedure

Check the HDFS service status.

  1. Log in to FusionInsight Manager and choose O&M > Alarm > Alarms. On the page that is displayed, check whether "ALM-14000 HDFS Service Unavailable" is reported.

    • If yes, go to 2.
    • If no, go to 3.

  2. Clear this alarm according to the alarm help.

    After the alarm is cleared, wait a few minutes and check whether the alarm GuardianService Unavailable is cleared.
    • If yes, no further action is required.
    • If no, go to 3.

Check all TokenServer instances.

  1. Log in to the node where the TokenServer instance resides as user omm and run the ps -ef|grep "guardian.token.server.Server" command to check whether the TokenServer process exists on the node.

    • If yes, go to 5.
    • If no, restart the faulty TokenServer instance and go to 4.

  2. In the alarm list, check whether the alarm "Guardian Service Unavailable" is cleared.

    • If yes, no further action is required.
    • If no, go to 5.

Collect fault information.

  1. On FusionInsight Manager, choose O&M > Log > Download.
  2. Expand the Service drop-down list, and select Guardian for the destination cluster.
  3. Click in the upper right corner, and set Start Date and End Date for log collection to 1 hour ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Contact O&M personnel and provide the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None