Basic Concepts
This chapter presents explanations of basic concepts of Kafka.
Topic
A topic is a category for messages. Messages are created, retrieved, and managed in the form of topics.
Topics adopt the publish-subscribe pattern. Producers publish messages into topics. One or more consumers subscribe to the messages in the topics. The producers and consumers are not directly linked to each other.
Producer
A producer publishes messages into topics. The messages are then delivered to other systems or modules for processing as agreed.
Consumer
A consumer subscribes to messages in topics and processes the messages. For example, a monitoring and alarm platform (a consumer) subscribing to log messages in certain topics can identify alarm logs and then send SMS or email alarm notifications.
Broker
A broker is a Kafka process in a Kafka cluster. Each process runs on a server, so a broker includes the storage, bandwidth, and other server resources.
Partition
Messages in a topic are distributed to multiple partitions to achieve scalability and fault tolerance.
Replica
A replica is a redundant copy of a partition in a topic. Each partition can have one or more replicas, enabling message reliability.
Messages in each partition are fully replicated and synchronized, preventing data loss if one replica fails.
Each partition has one replica as the leader which handles the creation and retrievals of all messages. The rest replicas are followers which replicate the leader.
Topics and partitions are logical concepts, while replicas and brokers are physical concepts. The following diagram shows the relationships between partitions, brokers, and topics in messages streaming.
![](https://support.huaweicloud.com/intl/en-us/productdesc-dms/en-us_image_0168129522.png)
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot