ALM-45452 ClickHouse's Local Disk Space Is Below the Cold-Hot Separation Threshold

Alarm Description

When cold-hot separation is enabled, the system checks the remaining space of the local disk specified in the cold-hot separation policy every 5 minutes. This alarm is generated if the remaining space is lower than the move_factor threshold.

This alarm is automatically cleared when the remaining space of the local disk is greater than the move_factor threshold.

Alarm Attributes

Alarm Parameters

Impact on the System

Some hot data on the local disk is moved to OBS, affecting the read and write performance of the system.

Possible Causes

The local disk capacity configured for cold-hot separation on the ClickHouseServer node is too small.

Handling Procedure

1. Log in to FusionInsight Manager, choose O&M > Alarm > Alarms, and view the role name and the IP address of the hostname in Location.
2. Expand the disk capacity of the node for which the alarm is generated.
3. Check whether the alarm is cleared after disk expansion.
   • If yes, no further action is required.
   • If no, go to 4.

Collect fault information.

4. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
5. Expand the Service drop-down list, and select ClickHouse for the target cluster.
6. Expand the Hosts drop-down list. In the Select Host dialog box that is displayed, select the abnormal host, and click OK.
7. Click the edit icon in the upper right corner, and set Start Date and End Date for log collection to 1 hour ahead of and after the alarm generation time, respectively. Then, click Download.
8. Contact O&M engineers and provide the collected logs.

Alarm Clearance

This alarm is automatically cleared after the fault is rectified.

Related Information

None.