Updated on 2025-09-05 GMT+08:00

Scaling Out a Logstash Cluster

If the workloads on the data plane of a Logstash cluster increase, you can scale out the cluster by adding more nodes.

You may scale out a Logstash cluster for the following purposes:

  • To ensure continuous data availability, more nodes may be added to a Logstash cluster to enhance fault tolerance.
  • In the face of fast data growth, more nodes may be added to a Logstash cluster to increase data processing capacity.
  • More nodes may be added to a Logstash cluster to execute more complex data processing tasks, such as data enrichment and ETL.

Scale-out process: Add more nodes of the appropriate specifications to the Logstash cluster and modify cluster configuration.

Prerequisites

  • The cluster status is Available, and there are no ongoing tasks.
  • Your CSS resource quotas are sufficient for the capacity expansion you are about to perform. You can check available resources on the Modify Configuration page.
    Figure 1 Checking available resources

Impact on Billing

For a pay-per-use cluster, you can see its new price when confirming the scale-out or scale-up on the console. After the scale-out or scale-up is complete, the new price will apply. For pricing details, see Cloud Search Service Price Calculator.

For a yearly/monthly cluster, a new order will be placed after you confirm the scale-out or scale-up. Then you can check the new price.

Change Impact

Scaling out a Logstash cluster does not affect services. However, once started, a scale-out task cannot be stopped until it succeeds or fails.

Scale-out Duration

The scale-out operation takes 10 to 30 minutes, depending on the cluster's scheduling capabilities.

Adding New Nodes

  1. Log in to the CSS management console.
  2. In the navigation pane on the left, choose Clusters > Logstash.
  3. In the cluster list, find the target cluster, and choose More > Modify Configuration in the Operation column. The Modify Configuration page is displayed.
  4. Select the Scale Cluster tab and click Scale out to set parameters.
    Table 1 Adding new nodes

    Parameter

    Description

    Action

    Select Scale out.

    Resources

    Quantities of resources added.

    Nodes

    Increase the number of nodes in the Nodes column.

    Figure 2 Adding more nodes
  5. Click Next.
  6. Confirm the information and click Submit.
  7. Click Back to Cluster List to go back to the Clusters page. The Task Status is Scaling out. When Cluster Status changes to Available, the cluster has been successfully scaled out.

Related Documents

You can also expand the capacity of a Logstash cluster by upgrading node specifications. For details, see Changing the Node Specifications of a Logstash Cluster.