Changing Kafka Partition Quantity

Modifying Topic Partitions on the Console

1. Log in to the console.
2. Click in the upper left corner to select a region.
   

   Select the region where your Kafka instance is located.

3. Click and choose Application > Distributed Message Service (for Kafka) to open the console of DMS for Kafka.
4. Click the desired Kafka instance to view the instance details.
5. In the navigation pane, choose Topics.
6. Modify the number of partitions using either of the following methods:
   • Select one or more topics and click Edit Topic in the upper left corner.
   • In the row containing the desired topic, click Edit.

7. In the Edit Topic dialog box, enter the number of partitions and click OK.
   

   • The number of partitions can only be increased.
   • To ensure performance, the Kafka console allows a maximum of 200 partitions for each topic.
   • The total partitions of all topics cannot exceed the maximum partitions of an instance. The maximum partitions of an instance vary by instance specifications. For details, see Kafka Instance Specifications.

Modifying Topic Partitions on Kafka Manager

1. Log in to Kafka Manager.
2. Choose Topic > List to view the list of topics.
3. Click a topic to view its details.
4. Click Add Partitions.
   Figure 1 Topic details page
   

5. Enter the number of partitions and click Add Partitions.
   Figure 2 Adding partitions
   

   If "Done" is displayed, the partitions are added successfully.

   Figure 3 Partitions added
   
   

   • The number of partitions can only be increased.
   • To ensure performance, a partition number within 200 is recommended for each topic.
   • The total partitions of all topics cannot exceed the maximum partitions of an instance. The maximum partitions of an instance vary by instance specifications. For details, see Kafka Instance Specifications.

Modifying Topic Partitions on the Client

If your Kafka client version is later than 2.2, you can use kafka-topics.sh to change the partition quantity.

For an instance with SASL enabled, if allow.everyone.if.no.acl.found is set to false, topic partition quantity cannot be modified through the client.

• For a Kafka instance with SASL disabled, run the following command in the /bin directory of the Kafka client:

  ./kafka-topics.sh --bootstrap-server ${connection-address} --topic ${topic-name} --alter --partitions ${number-of-partitions}

  Parameter description:

  • connection-address: can be obtained from the Connection area on the Basic Information page on the Kafka console.
  • topic-name: topic name.
  • number-of-partitions: number of partitions in a topic. To ensure performance, a partition number within 200 is recommended for each topic.

  Example:

  [root@ecs-kafka bin]# ./kafka-topics.sh --bootstrap-server 192.168.xx.xx:9092,192.168.xx.xx:9092,192.168.xx.xx:9092 --topic topic-01 --alter --partitions 6
  [root@ecs-kafka bin]#

• For a Kafka instance with SASL enabled, do as follows:
  1. (Optional) If the username and password, and the SSL certificate has been configured, skip this step and go to 2. Otherwise, do as follows:

     Create the ssl-user-config.properties file in the /config directory of the Kafka client. Add the username and password, and the SSL certificate configuration by referring to 3.

  2. Run the following command in the /bin directory of the Kafka client:

     ./kafka-topics.sh --bootstrap-server ${connection-address} --topic ${topic-name} --alter --partitions ${number-of-partitions} --command-config ../config/ssl-user-config.properties 

     Parameter description:

     • connection-address: can be obtained from the Connection area on the Basic Information page on the Kafka console.
     • topic-name: topic name.
     • number-of-partitions: number of partitions in a topic. To ensure performance, a partition number within 200 is recommended for each topic.

     Example:

     [root@ecs-kafka bin]# ./kafka-topics.sh --bootstrap-server 192.168.xx.xx:9093,192.168.xx.xx:9093,192.168.xx.xx:9093 --topic topic-01 --alter --partitions 6 --command-config ../config/ssl-user-config.properties
     [root@ecs-kafka bin]#