Help Center > > User Guide> FusionInsight Manager Operation Guide (Applicable to 3.x)> Alarm Reference (Applicable to MRS 3.x)> ALM-13009 ZooKeeper Znode Capacity Usage Exceeds the Threshold

ALM-13009 ZooKeeper Znode Capacity Usage Exceeds the Threshold

Updated at: Aug 17, 2021 GMT+08:00

Description

The system checks the level-2 Znode status in the ZooKeeper data directory every hour. This alarm is generated when the system detects that the capacity usage exceeds the threshold.

Attribute

Alarm ID

Alarm Severity

Automatically Cleared

13009

Major

Yes

Parameters

Name

Meaning

Source

Specifies the cluster for which the alarm is generated.

ServiceName

Specifies the service name for which the alarm is generated.

ServiceDirectory

Specifies the directory for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

Trigger Condition

Specifies the cause of the alarm.

Impact on the System

A large amount of data is written to the ZooKeeper data directory. As a result, ZooKeeper cannot provide services properly.

Possible Causes

  • A large amount of data is written to the ZooKeeper data directory.
  • The user-defined threshold is inappropriate.

Procedure

Check whether a large amount of data is written into the directory for which the alarm is generated.

  1. On FusionInsight Manager, choose O&M > Alarm > Alarms. Confirm the Znode for which the alarm is generated in Location of this alarm.
  2. Choose Cluster > Name of the desired cluster > Services > ZooKeeper and click Resource. Click By capacity in Used Resources (By Second-Level Znode) and check whether a large amount of data is written into the top Znode directory.

    • If yes, go to 3.
    • If no, go to 5.

  3. Log in to FusionInsight Manager, choose O&M > Alarm > Alarms, select Location from the drop-down list box next to ALM-13009 ZooKeeper Znode Capacity Usage Exceeds the Threshold, and obtain the Znode path in ServiceDirectory.
  4. Log in to the ZooKeeper client as a cluster user and delete unwanted data in the Znode for which the alarm is generated.
  5. Log in to FusionInsight Manager, choose Cluster > Name of the desired cluster > Services > ZooKeeper > Configurations > All Configurations, and search for max.data.size, which is the maximum capacity quota of the ZooKeeper directory in bytes. Search for the GC_OPTS configuration item and check the value of Xmx.
  6. Compare the values of max.data.size and Xmx multiplied by 0.65. The threshold is the smaller value multiplied by 80%. You can change the values of max.data.size and Xmx to increase the threshold.
  7. Check whether the alarm is cleared.

    • If yes, no further action is required.
    • If no, go to 8.

Collect fault information.

  1. On the FusionInsight Manager portal, choose O&M > Log > Download.
  2. Select ZooKeeper in the required cluster from the Service.
  3. Click in the upper right corner, and set Start Date and End Date for log collection to 10 minutes ahead of and after the alarm generation time, respectively. Then, click Download.
  4. Contact the O&M personnel and send the collected logs.

Alarm Clearing

After the fault is rectified, the system automatically clears this alarm.

Related Information

None

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel