Help Center> Distributed Message Service for Kafka> User Guide (Kuala Lumpur Region)> FAQs> Topics and Partitions> Why Is Partition Quantity Limited?
Updated on 2022-08-12 GMT+08:00
View PDF

Why Is Partition Quantity Limited?

Kafka manages messages by partition. If there are too many partitions, message creation, storage, and retrieval will be fragmented, affecting the performance and stability. If the total number of partitions of topics reaches the upper limit, you cannot create more topics.

The partition limit varies depending on the flavor, as shown in the following table.

Table 1 Kafka instance specifications

Bandwidth

Brokers

Underlying Resource Type

I/O Type

TPS (High-Throughput)

TPS (Synchronous Replication)

Maximum Partitions

100 MB/s

3

c6_2 vCPUs | 4 GB

High I/O

100,000

60,000

300

c6_2 vCPUs | 4 GB

Ultra-high I/O

100,000

80,000

300

300 MB/s

3

c6_4 vCPUs | 8 GB

High I/O

300,000

150,000

900

c6_4 vCPUs | 8 GB

Ultra-high I/O

300,000

200,000

900

600 MB/s

4

c6_8 vCPUs | 16 GB

Ultra-high I/O

600,000

300,000

1800

1200 MB/s

8

c6_8 vCPUs | 16 GB

Ultra-high I/O

1.2 million

400,000

1800
Parent topic: Topics and Partitions