Application Scenarios

Kafka is a distributed message releasing and subscription system. It provides features such as message persistence, high-throughput, multi-client support, and real-time message processing. Kafka is applicable to online and offline message consumption as well as Internet service massive data collection scenarios, such as conventional data collection, active website tracking, aggregation of operation data in statistics systems (monitoring data), and log collection.

Reasons for using the message system

• Decoupling: The message system inserts a hidden, data-based interface layer during data processing.
• Redundancy: Message queues are persistent, preventing data loss.
• Scalability: Message queues are decoupled from data processing, facilitating the expansion of data processing.
• Recoverability: Data processing can be recovered in case of failures.
• Sequence guarantee: Message queues help ensure the message sequence and keep the messages in a partition in order.
• Asynchronous communication: Messages can join the queue for further processing when necessary.