Updated on 2024-11-29 GMT+08:00

Traffic Control

Scenario

The traffic control feature implements instance-level traffic limiting to improve cluster stability. By default, Elasticsearch controls the size of the bulk request body but not the number of requests. You can enable the traffic control for the number of requests.

Procedure

  1. Log in to Manager.
  2. On Manager, choose Cluster > Name of the desired cluster > Services > Elasticsearch > Configurations > All Configurations > Elasticsearch > Dynamic Parameter. Search for the following parameters in the search box and configure them.

    Parameter

    Default Value

    Description

    bulk.size.limit

    15MB

    Specifies the maximum amount of data that can be submitted using a bulk command.

    rate.limiter.enable

    false

    Indicates whether to enable traffic control. To enable this function, set this parameter to true.

    rate.limiter.node.max_qps

    100

    Specifies the maximum number of requests that a single instance can receive per second.

    rate.limiter.client.max_qps

    200

    Specifies the maximum number of requests that a single client instance can receive per second.

    • Configuration suggestions on the amount of data to be submitted:

      By default, the maximum amount of data that can be submitted using a bulk command is 15 MB. When this value is set between 5 MB and 15 MB, the write performance is optimal.

    • Configuration suggestions on the number of requests to be received:

      The traffic control is not precise. Some deviations may occur in the actual situation. Thus, you need to adjust the parameter configuration as required.

      It is advised to set the value of set rate.limiter.node.max_qps to half the value of rate.limiter.client.max_qps.

      The threshold of rate.limiter.client.max_qps can be evaluated based on the following formula: Total traffic control threshold of concurrent requests/(0.5 x Number of EsNodes + Number of EsClients)

  3. After the modification, click Save in the upper left corner. In the dialog box displayed, click OK.