Help Center > > User Guide> FusionInsight Manager Operation Guide (Applicable to 3.x)> Alarm Reference (Applicable to MRS 3.x)> ALM-12011 Manager Data Synchronization Exception Between the Active and Standby Nodes

ALM-12011 Manager Data Synchronization Exception Between the Active and Standby Nodes

Updated at: Mar 25, 2021 GMT+08:00

Description

The system checks data synchronization between the active and standby Manager nodes every 60 seconds. This alarm is generated when the standby Manager fails to synchronize files with the active Manager.

This alarm is cleared when the standby Manager synchronizes files with the active Manager.

Attribute

Alarm ID

Alarm Severity

Auto Clear

12011

Critical

Yes

Parameters

Name

Meaning

Source

Specifies the cluster or system for which the alarm is generated.

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

Impact on the System

Some configurations will be lost after an active/standby switchover because the configuration files on the standby Manager are not updated. Maybe Manager and some components cannot run properly.

Possible Causes

The link between the active and standby Managers is interrupted or The storage space of the /srv/BigData/LocalBackup directory is full.

Procedure

Check whether the network between the active Manager server and the standby Manager server is normal.

  1. In the FusionInsight Manager portal, click O&M > Alarm > Alarms, click in the row where the alarm is located and obtain the standby Manager server IP address (Peer Manager IP address) in the alarm details.
  2. Log in to the active Manager server as user root.
  3. Run the ping standby Manager IP address command to check whether the standby Manager server is reachable.

    • If yes, go to 6.
    • If no, go to 4.

  4. Contact the network administrator to check whether the network is faulty.

    • If yes, go to 5.
    • If no, go to 6.

  5. Rectify the network fault and check whether the alarm is cleared from the alarm list.

    • If yes, no further action is required.
    • If no, go to 6.

Check whether the storage space of the /srv/BigData/LocalBackup directory is full.

  1. Run the following command to check whether the storage space of the /srv/BigData/LocalBackup directory is full:

    df -hl /srv/BigData/LocalBackup

    • If yes, go to 7.
    • If no, go to 10.

  2. Run the following command to clear unnecessary backup files:

    rm -rf Directory to be cleared

    Example:

    rm -rf /srv/BigData/LocalBackup/0/default-oms_20191211143443

  3. On FusionInsight Manager, choose O&M > Backup and Restoration > Backup Management.

    In the Operation column of the backup task to be performed, click Configure and change the value of Maximum Number of Backup Copies to reduce the number of backup file sets.

  4. Wait about 1 minute and check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to 10.

Collect fault information.

  1. On the FusionInsight Manager, choose O&M > Log > Download.
  2. Select the following nodes from the Service and click OK:

    • OmmServer
    • Controller
    • NodeAgent

  3. Click in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Contact the O&M personnel and send the collected log information.

Alarm Clearing

After the fault is rectified, the system automatically clears this alarm.

Related Information

None

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel