Updated on 2023-05-06 GMT+08:00

Introduction

This document provides instructions for getting started with Distributed Message Service (DMS) for Kafka, including creating a Kafka instance on the console and connecting to a Kafka instance through an Elastic Cloud Server (ECS).

You can also create a Kafka instance by calling an API and connect to the instance in your service code.

Procedure

Figure 1 Procedure for using DMS for Kafka
  1. Prepare the environment.

    A Kafka instance runs in a Virtual Private Cloud (VPC). Before creating a Kafka instance, ensure that a VPC is available.

    After a Kafka instance is created, download and install the Kafka open-source client on your ECS before creating and retrieving messages.

  2. Create a Kafka instance.

    When creating an instance, you can choose whether to enable SASL. If SASL is enabled, data is encrypted for transmission, improving data security. The SASL setting can be configured only when you create an instance. After an instance is created, the SASL setting cannot be changed.

  3. (Optional) Create a topic.

    If automatic topic creation is not enabled during Kafka instance creation, you need to manually create topics for creating and retrieving messages.

  4. Connect to the instance.
    You can connect to a Kafka instance with or without SASL.
    • Without SASL: Supports private network access and public network access.
    • With SASL: Supports private network access and public network access.
  5. Configure alarm rules.

    Configure alarm rules for a Kafka instance to monitor the service running status.

For details about Kafka concepts, see Basic Concepts.