Modifying Instance Specifications

Scenario

After creating a Kafka instance, you can increase its bandwidth (only for old specifications), broker quantity (only for new specifications), storage space, and broker flavor.

Distinguishing between old and new specifications:

• Old specifications: In the instance list, the instance specification is displayed as bandwidth (for example, 100 MB/s).
• New specifications: In the instance list, the instance specification is displayed as the ECS flavor multiplied by the number of brokers (for example, c6.2u4g.cluster*4 brokers).

Figure 1 Instance list

Notes and Constraints

• You can change instances to higher specifications, but not lower ones.
• For instances using old specifications, you can increase only the storage space, bandwidth, or broker flavor in one operation.
• For instances using new specifications, you can only expand the storage space, add brokers, or increase the broker flavor in one operation.
• You can expand the storage space 20 times.
• If you increase the bandwidth or add brokers, the maximum number of partitions will also be increased. When you increase the bandwidth or change the broker quantity, the storage space is proportionally expanded based on the current disk space. For example, assume that the original number of brokers of an instance is 3 and the disk size of each broker is 200 GB. If the broker quantity changes to 10 and the disk size of each broker is still 200 GB, the total disk size becomes 2000 GB.
• You can increase the broker flavor in the CN North-Beijing4, CN South-Guangzhou, and AP-Singapore (only for new specifications) regions.

Procedure

1. Log in to the management console.
2. Click in the upper left corner to select a region.
   

   Select the region where your Kafka instance is located.

3. Click and choose Application > Distributed Message Service (for Kafka) to open the console of DMS for Kafka.
4. In the row containing the instance for which you want to modify the specifications, choose More > Modify Specifications in the Operation column.
5. Specify the required storage space, broker quantity, broker flavor, or bandwidth.
   To modify old specifications, perform the following steps:

   • Increase the bandwidth.

     Specify a new bandwidth and click Next. Confirm the configurations and click Submit.

     View the new bandwidth of the instance in the Specifications column in the instance list.

     

     • Bandwidth is increased by scaling out brokers. The original brokers and services are not affected.
     • New topics are created on new brokers. After the bandwidth is increased, the original topics are still on the original brokers. To use new brokers, migrate the topics by using Kafka Manager or create new topics.
     • If public access is enabled and EIPs are configured for the instance, configure EIPs for the new brokers when expanding the bandwidth.
   • Expand the storage space.

     Specify a new storage space and click Next. Confirm the configurations and click Submit.

     View the new storage space in the Used/Available Storage Space (GB) column in the instance list.

     

     • Storage space expansion does not affect services.
     • Available storage space = Actual storage space – Storage space for storing logs and ZooKeeper data – Disk formatting loss

       For example, if the storage space is expanded to 700 GB, the storage space for storing logs and ZooKeeper data is 100 GB, and the disk formatting loss is 7 GB, then the available storage space after capacity expansion will be 593 GB.

   • Increase the broker flavor.

     Enable Scale-up, select a new bandwidth for Flavor, and click Next. Confirm the configurations and click Submit.

     Scale-up means that a higher broker flavor is used, and scale-out means that the number of brokers is increased.

     

     Modifying the broker flavor will restart brokers and may cause disconnections. Single-replica topics cannot provide message creation and retrieval during this time.

   To modify new specifications, perform the following steps:

   • Expand the storage space.

     For Modify By, select Storage. For Storage Space per Broker, specify a new storage space, and click Next. Confirm the configurations and click Submit.

     View the new storage space (Storage space per broker x Number of brokers) in the Used/Available Storage Space (GB) column in the instance list.

     

     • Storage space expansion does not affect services.
     • Available storage space = Actual storage space – Storage space for storing logs and ZooKeeper data – Disk formatting loss

       For example, if the storage space is expanded to 700 GB, the storage space for storing logs and ZooKeeper data is 100 GB, and the disk formatting loss is 7 GB, then the available storage space after capacity expansion will be 593 GB.

   • Add brokers.

     For Modify By, select Brokers. Then, enter the number of brokers and click Next. Confirm the configurations and click Submit.

     View the number of brokers in the Specifications column in the instance list.

     

     • Adding brokers does not affect the original brokers or services.
     • New topics are created on new brokers. After the bandwidth is increased, the original topics are still on the original brokers. To use new brokers, migrate the topics by using Kafka Manager or create new topics.
     • If public access is enabled and EIPs are configured for the instance, configure EIPs for the new brokers.
   • Increase the broker flavor.

     For Modify By, select Broker Flavor. Then, select a new flavor and click Next. Confirm the configurations and click Submit.

     View the broker flavor in the Flavor column of the instance list.

     

     Modifying the broker flavor will restart brokers and may cause disconnections. Single-replica topics cannot provide message creation and retrieval during this time.