Updated on 2024-10-25 GMT+08:00

Process of Using Kafka

Distributed Message Service for Kafka is a message queuing service that is based on the open-source Apache Kafka. It provides Kafka instances with isolated computing, storage, and bandwidth resources. The following figure shows the process of message production and consumption using a Kafka instance.

Figure 1 Process of using Kafka
  1. Creating an IAM User and Granting DMS for Kafka Permissions

    Create IAM users and grant them only the DMS for Kafka permissions required to perform a given task based on their job responsibilities.

  2. Buying a Kafka Instance

    Kafka instances are tenant-exclusive, and physically isolated in deployment.

  3. Creating a Kafka Topic

    Create a topic for storing messages so that producers can produce messages and consumers can subscribe to messages.

  4. Connecting to an Instance

    The client uses commands to connect to Kafka instances in a private or public network, and produces and consumes messages.