Help Center/ MapReduce Service/ User Guide/ MRS Cluster O&M/ MRS Cluster Alarm Handling Reference/ ALM-45430 Permission Metadata Synchronization Failed on the Added ClickHouse Node
Updated on 2024-09-23 GMT+08:00
View PDF
Share

ALM-45430 Permission Metadata Synchronization Failed on the Added ClickHouse Node

This section applies only to MRS 3.1.2 or later.

Alarm Description

This alarm is generated when user and permission information fails to be synchronized during ClickHouse capacity expansion.

Alarm Attributes

Alarm ID

Alarm Severity

Auto Cleared

45430

Major

No

Alarm Parameters

Parameter

Description

Source

Specifies the cluster for which the alarm was generated.

ServiceName

Specifies the service for which the alarm was generated.

RoleName

Specifies the role for which the alarm was generated.

HostName

Specifies the host for which the alarm was generated.

Impact on the System

The created user does not have operation permissions on the node.

Possible Causes

A node is stopped or faulty during capacity expansion.

Handling Procedure

  1. On FusionInsight Manager, choose Cluster > Services > ClickHouse > Instance.
  2. Check whether an instance is stopped, decommissioned, or faulty.

    • If yes, go to 3.
    • If no, go to 4.

  3. Start the instance or rectify the instance fault until all instances are running properly.
  4. On FusionInsight Manager, choose O&M > Alarm > Alarms, locate this alarm and the faulty host based on the location information.
  1. Log in to the faulty host as user omm.
  2. Run the following commands to initialize environment variables:

    source ${BIGDATA_HOME}/FusionInsight_ClickHouse_*/*_*_ClickHouseServer/etc/ENV_VARS

    source ${BIGDATA_HOME}/FusionInsight_ClickHouse_*/*_*_ClickHouseServer/etc/clickhouse-env.sh

    export CLICKHOUSE_CONF_DIR=${CLICKHOUSE_CONF_DIR}

  3. Run the following command to run the metadata synchronization tool to synchronize metadata from the existing node to the faulty node:

    sh ${BIGDATA_HOME}/FusionInsight_ClickHouse_*/install/FusionInsight-ClickHouse-*/clickhouse/sbin/clickhouse-create-meta.sh true

  4. Run the following command to view the log information and check whether the metadata has been synchronized:

    vim /var/log/Bigdata/clickhouse/clickhouseServer/start.log

    If the synchronization is complete, go to 9.

    If the synchronization fails, go to 10.

  5. On FusionInsight Manager, choose O&M > Alarm > Alarms. In the Alarm ID column, locate the corresponding alarm and click Clear in the Operation column. In the displayed dialog box, click OK to manually clear the alarm.

Collect the fault information.

  1. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
  2. Expand the Service drop-down list, select ClickHouse for the target cluster, and click OK.
  3. Choose the corresponding host form the host list.
  4. Click in the upper right corner, and set Start Date and End Date for log collection to 30 minutes ahead of and after the alarm generation time respectively. Then, click Download.
  5. Contact O&M personnel and provide the collected logs.

Alarm Clearance

This alarm needs to be manually cleared after the fault is rectified.

Related Information

None