Updated on 2024-09-23 GMT+08:00

ALM-12172 Failed to Report Metrics to Cloud Eye

Alarm Description

After metric sharing is enabled for a cluster, the Controller periodically collects cluster metrics and reports them to Cloud Eye.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

12172

Major

Yes

Alarm Parameters

Parameter

Description

Source

Specifies the cluster or system for which the alarm was generated.

ServiceName

Specifies the service for which the alarm was generated.

RoleName

Specifies the role for which the alarm was generated.

HostName

Specifies the host for which the alarm was generated.

Impact on the System

MRS monitoring metrics are unavailable on Cloud Eye.

Possible Causes

  • Failed to call Cloud Eye APIs due to insufficient permissions.
  • Failed to report data to Cloud Eye due to network problems.
  • Failed to report data to Cloud Eye due to internal errors.

Handling Procedure

  1. Log in to FusionInsight Manager, choose O&M > Alarm > Alarms, and view the additional information in the alarm details.
  2. Rectify the fault based on the following scenarios:

    • If "Call CES to send metrics fail. Permission exception" is displayed in the additional information, the token of the resource tenant is invalid. Restart the Controller and obtain the token again. The detailed procedure is as follows:
      1. Log in to FusionInsight Manager, click the task center icon in the upper right corner, and verify that no task is being executed in the task center.
      2. Use PuTTY to log in to the active management node as user omm.
      3. Restart the controller.

        sh ${BIGDATA_HOME}/om-server/om/sbin/restart-controller.sh

      4. Wait for 5 minutes and check whether the alarm is cleared.
        • If yes, no further action is required.
        • If no, go to 3.
    • If "Call CES to send metrics fail. Request CES error code xxx" or "CES internal error code xxx" is displayed, the function service is abnormal. Go to 3.
    • If "Call CES to send metrics fail. Too many request" is displayed in additional alarm information, the service request triggers triffic control. Go to 3.

Collect fault information.

  1. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
  2. On the displayed page, select Controller of OMS for Service, and click OK. Select the active node for Host and click OK.
  3. Click in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Contact O&M personnel and provide the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None