Product Functions

Buying a Kafka instance

Before using DMS for Kafka, you must purchase a Kafka instance. Your Kafka instance will be deployed in physical isolation and exclusively used by you. For details, see Buying a Kafka Instance.

Connecting to Kafka

Connect to a Kafka instance using an open-source Kafka client to create and retrieve messages.

Depending on whether you enable or disable SASL_SSL, the port for connecting to an instance varies. If you enable SASL_SSL, you will also need to configure certificates. For details, see Connecting to an Instance.

Managing Topics

A topic is a stream of messages. If automatic topic creation is not enabled during Kafka instance creation, you need to manually create topics for creating and retrieving messages. For details, see Creating a Kafka Topic.

After creating a topic, you can change the retention duration of Kafka messages as required. For details, see Changing Kafka Message Retention Period.

Modifying Instance Specifications

After creating a Kafka instance, you can increase its bandwidth, broker quantity, storage space, and broker flavor, or decrease its broker flavor. For details, see Modifying Instance Specifications.

Public Access

To access a Kafka instance over a public network, you can enable public access and configure public network bandwidth for the instance. After the instance has been created with public access enabled, you can modify the public network bandwidth. Currently, you can increase but cannot decrease the bandwidth. For details, see Configuring Kafka Public Access.

In some regions, public access cannot be enabled for Kafka instances whose bandwidth is set to 100 MB/s.

Querying Messages

You can view the size, creation time, and body of messages in topics. For details, see Viewing Kafka Messages.

Managing Kafka Manager

Kafka Manager is an open-source tool for managing Kafka. It can be used through a web browser. In Kafka Manager, you can view the monitoring statistics and broker information of your Kafka clusters. For details, see Using Kafka Manager.

Smart Connect

Smart Connect can be enabled for DMS for Kafka for data synchronization between Kafka instances and other cloud services (such as OBS), or between Kafka instances. For details, see Enabling Smart Connect.

Managing Users

DMS for Kafka supports ACL permission management for topics. You can differentiate the operations that different SASL_SSL users are allowed to perform on a topic by granting the users different permissions. For details, see Configuring Kafka ACL Users.

Managing Consumer Groups

You can delete consumer groups, reset consumer offsets, and view consumer connection addresses. For details, see Managing Consumer Groups.

Modifying Kafka Parameters

Your instances, topics, and consumers come with default configuration parameter settings. You can modify common parameters on the console. For details, see Modifying Kafka Instance Configuration Parameters.

Tags

Tags facilitate Kafka instance identification and management.

Tags can be added in instance creation, or on the instance details page. For details, see Configuring Kafka Instance Tags.

Monitoring

Cloud Eye monitors Kafka instance metrics in real time. You can view these metrics on the Cloud Eye console. For more information, see Monitoring and Alarms.

Auditing

Kafka operations are recorded by Cloud Trace Service (CTS), which is a log audit service provided by Huawei Cloud. CTS collects, stores, and queries records of operations on Kafka instances, facilitating security analysis, compliance audit, resource tracking, and fault locating. For details, see Viewing Kafka Audit Logs.

APIs

DMS for Kafka provides REST APIs that support HTTP/HTTPS methods. You can call APIs to create, delete, and modify instances. For details, see API Overview.