Updated on 2024-04-19 GMT+08:00

Replacing a Specified Node

If a node in the cluster is faulty, you can create a new node with the same specifications to replace it.

Prerequisites

The target cluster is available and has no tasks in progress.

Constraints

  • Only one node can be replaced at a time.
  • The ID, IP address, specifications, and AZ of the new node will be the same as those of the original one.
  • The configurations you modified manually will not be retained after node replacement. For example, if you have manually added a return route to the original node, you need to add it to the new node again after the node replacement is complete.
  • If the node you want to replace is a data node (ess) or cold data node (ess-cold), pay attention to the following precautions:
    1. For data node replacement, data from the original node will be migrated to other nodes, and then the node will be rebuilt. Therefore, the total number of replicas and primary shards of each index in the cluster must be less than the total number of data nodes (including ess and ess-cold) in the cluster. The time required for node replacement is closely related to the time required for migrating data to other nodes.
    2. The AZ of the node to be replaced must have two or more data nodes (including ess and ess-cold).
    3. If the cluster of the node to be replaced does not have a master node (ess-master), the number of available data nodes (including ess and ess-cold) in the cluster must be greater than or equal to 3.
    4. The preceding precautions do not apply if you are replacing a master node (ess-master) or client node (ess-client).
    5. The precautions 1 to 4 do not apply if you are replacing a faulty node, regardless of its type. Faulty nodes are not included in _cat/nodes.

Procedure

  1. Log in to the CSS management console.
  2. In the navigation pane, choose a cluster type. The cluster management page is displayed.
  3. Choose More > Modify Configuration in the Operation column of the target cluster. The Modify Configuration page is displayed.
  4. On the Modify Configuration page, click the Replace Node tab.
  5. On the Replace Node tab page, set the following parameters:
    • Agency: Select an IAM agency to grant the current account the permission to switch AZs.

      If no agency is available, click Create IAM Agency to go to the IAM console and create an agency.

      The selected agency must be assigned the Tenant Administrator or VPC Administrator policy.

    • Whether to perform data migration: If this option is selected, data migration is performed. If the target node has disabled indexes or indexes that have no replicas, this option must be selected.
    • Select the node to be replaced in the data node table.
    Figure 1 Replacing a specified node
  6. Click Submit.
  7. Click Back to Cluster List to switch to the Clusters page. The Task Status is Upgrading. When Cluster Status changes to Available, the node has been successfully replaced.