All Documentation
Distributed Message Service for Kafka
Distributed Message Service for Kafka
What's New
Function Overview
Product Bulletin
Vulnerability Notice
Vulnerability Fixing Policies
Service Overview
Infographics
What Is DMS for Kafka?
Product Advantages
Application Scenarios
Specifications
Comparing Kafka and RabbitMQ
Comparing DMS for Kafka and Open-Source Kafka
Security
Shared Responsibilities
Identity Authentication and Access Control
Data Protection
Audit and Logs
Resilience
Security Risk Monitoring
Certificates
Notes and Constraints
Related Services
Basic Concepts
Permissions Management
Billing
Getting Started
Introduction
Step 1: Prepare the Environment
Step 2: Create a Kafka Instance
Step 3: Create a Topic
Step 4: Connect to a Kafka Instance to Create and Retrieve Messages
Connecting to an Instance Without SASL
Connecting to an Instance with SASL
Step 5: Configure Alarm Rules
User Guide
Permissions Management
Creating a User and Granting DMS for Kafka Permissions
DMS for Kafka Custom Policies
DMS for Kafka Resources
DMS for Kafka Request Conditions
Preparing Required Resources
Buying an Instance
Accessing a Kafka Instance
Accessing a Kafka Instance Without SASL
Accessing a Kafka Instance with SASL
Connecting to Kafka Manager and Viewing Kafka Information
Cross-VPC Access to a Kafka Instance
Using DNAT to Access a Kafka Instance
Managing Instances
Modifying Instance Specifications
Viewing an Instance
Restarting an Instance
Deleting an Instance
Modifying the Information About an Instance
Configuring Public Access
Changing the Billing Mode from Pay-per-Use to Yearly/Monthly
Resetting Kafka Password
Resetting Kafka Manager Password
Restarting Kafka Manager
Managing Instance Tags
Viewing Background Tasks
Viewing Disk Usage
Managing Topics
Creating a Topic
Deleting a Topic
Modifying Topic Aging Time
Changing Partition Quantity
Modifying Synchronous Replication and Flushing Settings
Partition Reassignment
Viewing Sample Code
Exporting Topics
Managing Messages
Querying Messages
Managing Users
Creating a SASL_SSL User
Granting Permissions to a SASL_SSL User
Resetting the SASL_SSL Password
Deleting a SASL_SSL User
Managing Consumer Groups
Querying Consumer Group Details
Deleting a Consumer Group
Resetting the Consumer Offset
Viewing Consumer Connection Addresses
Smart Connect
Enabling Smart Connect
Creating a Smart Connect Task
Managing Smart Connect Tasks
Managing Kafka Quotas
Creating a Quota
Modifying a Quota
Deleting a Quota
Modifying Kafka Parameters
Quotas
Monitoring
Viewing Metrics
Kafka Metrics
Configuring Alarm Rules
Auditing
Operations Logged by CTS
Viewing Audit Logs
Best Practices
Optimizing Message Polling of DMS for Kafka Consumers
Improving Message Processing Efficiency
Migrating Kafka Services
Using MirrorMaker to Synchronize Data Across Clusters
Setting Parameters for Kafka Clients
Using Kafka Clients
Configuring an Alarm Rule for Available Messages
Developer Guide
Overview
Collecting Connection Information
Java
Configuring Kafka Clients in Java
Setting Up the Java Development Environment
Python
Go
Obtaining Kafka Clients
Using spring-kafka
Performance Whitepaper
Test Scenarios
Test Environment
Test Procedure
Test Results
API Reference
Before You Start
Overview
API Calling
Endpoints
Constraints
Concepts
API Overview
Calling APIs
Making an API Request
Authentication
Returned Values
Getting Started
APIs V2 (Recommended)
Lifecycle Management
Creating an Instance
Listing All Instances
Querying an Instance
Deleting an Instance
Modifying Instance Information
Batch Restarting or Deleting Instances
Instance Management
Resetting the Password
Resetting Kafka Manager Password
Restarting Kafka Manager
Configuring Automatic Topic Creation
Modifying the Private IP Address for Cross-VPC Access
Querying Kafka Cluster Metadata
Querying Consumer Group Details
Resetting Consumer Group Offset to the Specified Position
Querying Coordinator Details of a Kafka Instance
Adding Partitions to a Topic for a Kafka Instance
Reassigning Replicas of a Topic for a Kafka Instance
Querying the Disk Usage Status of Topics
Querying All Consumer Groups
Dumping Management
Creating a Dump Connector for an Instance
Creating a Dumping Task
Listing Dumping Tasks
Modifying Dumping Task Quotas
Querying a Dumping Task
Deleting a Dumping Task
Specification Modification Management
Modifying Instance Specifications
Querying Product Information for Instance Specification Modification
Topic Management
Creating a Topic for a Kafka Instance
Listing Topics of a Kafka Instance
Modifying Topics of a Kafka Instance
Batch Deleting Topics of a Kafka Instance
Querying Topic Details
User Management
Querying the User List
Creating a User
Deleting Users in Batches
Resetting a User Password
Querying User Permissions
Granting User Permissions
Message Query
Querying Messages
Querying a Message with a Specified Offset
Querying a Message with a Specified Time Period
Querying Offset of the Earliest Message in a Partition
Querying Offset of the Latest Message in a Partition
Background Task Management
Listing Background Tasks
Querying a Background Task
Deleting a Background Task
Tag Management
Batch Adding or Deleting Tags
Listing Tags of an Instance
Listing Tags of a Project
Other APIs
Listing Maintenance Time Windows
Listing AZ Information
Querying Product Specifications List
Querying Kafka Instance Monitoring Dimensions
Permissions Policies and Supported Actions
Out-of-Date APIs
API V1
APIs for Managing Instances
Creating an Instance
Querying an Instance
Modifying an Instance
Deleting an Instance
Restarting or Deleting Instances in Batches
Querying All Instances
Creating a Topic in a Kafka Instance
Querying a Topic in a Kafka Instance
Deleting Topics in a Kafka Instance in Batches
Other APIs
Querying AZ Information
Querying Product Specifications
Querying Maintenance Time Windows
Appendix
Status Code
Error Codes
Instance Status
Obtaining a Project ID
Obtaining the Account Name and Account ID
Change History
SDK Reference
SDK Overview
FAQs
Instances
Why Can't I Select Two AZs?
Why Can't I View the Subnet and Security Group Information When Creating a DMS Instance?
How Do I Select Storage Space for a Kafka Instance?
How Do I Choose Between High I/O and Ultra-high I/O?
Which Capacity Threshold Policy Should I Use?
Which Kafka Versions Are Supported?
What Is the ZooKeeper Address of a Kafka Instance?
Are Kafka Instances in Cluster Mode?
Can I Modify the Port for Accessing a Kafka Instance?
How Long Are Kafka SSL Certificates Valid for?
How Do I Synchronize Data from One Kafka Instance to Another?
How Do I Change the SASL_SSL Setting of a Kafka Instance?
Will a Kafka Instance Be Restarted After Its Enterprise Project Is Modified?
Are Kafka Brokers and ZooKeeper Deployed on the Same VM or on Different VMs?
Can I Delete a Kafka Instance Billed in Yearly/Monthly Mode?
Which Cipher Suites Are Supported by Kafka?
Can I Change an Instance from Single-AZ Deployment to Multi-AZ Deployment?
Does DMS for Kafka Support Cross-AZ Disaster Recovery? Where Can I View the AZs Configured for an Existing Instance?
Do Kafka Instances Support Disk Encryption?
Does Specification Modification Affect Services?
Can I Change the VPC and Subnet After a Kafka Instance Is Created?
Where Can I Find Kafka Streams Use Cases?
Can I Upgrade Kafka Instances?
Why Is the Version on the Console Different from That in Kafka Manager?
How Do I Bind an EIP Again?
Connections
Troubleshooting Kafka Connection Exceptions
How Do I Select and Configure a Security Group?
Can I Access a Kafka Instance Over a Public Network?
How Many Connection Addresses Does a Kafka Instance Have by Default?
Do Kafka Instances Support Cross-Region Access?
Do Kafka Instances Support Cross-VPC Access?
Do Kafka Instances Support Cross-Subnet Access?
Does DMS for Kafka Support Authentication with Kerberos?
Does DMS for Kafka Support Password-Free Access?
Obtaining Kafka Clients
How Do I Obtain the Public Access Address After Public Access Is Enabled?
Does DMS for Kafka Support Authentication on Clients by the Server?
Can I Use PEM SSL Truststore When Connecting to a Kafka Instance with SASL_SSL Enabled?
What Are the Differences Between JKS and CRT Certificates?
Which TLS Version Does DMS for Kafka Support?
Is There a Limit on the Number of Client Connections to a Kafka Instance?
How Many Connections Are Allowed from Each IP Address?
Can I Change the Private Network Addresses of a Kafka Instance?
Is the Same SSL Certificate Used for Different Instances?
Topics and Partitions
Is There a Limit on the Number of Topics in a Kafka Instance?
Why Is Partition Quantity Limited?
Can I Change the Partition Quantity?
Why Do I Fail to Create Topics?
Do Kafka Instances Support Batch Importing Topics or Automatic Topic Creation?
Why Do Deleted Topics Still Exist?
Why Can't I See "Create Topic" and "Delete Topic" Buttons on the Topic Management Page?
Can I View the Disk Space Used by a Topic?
Can I Add ACL Permissions for Topics?
What Should I Do If Kafka Storage Space Is Used Up Because Retrieved Messages Are Not Deleted?
How Do I Increase the Partition Quantity?
Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?
How Do I Disable Automatic Topic Creation?
Can I Delete Unnecessary Topics in a Consumer Group?
What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?
Why Does an Instance Contain Default Topics __trace and __consumer_offsets?
Consumer Groups
Do I Need to Create Consumer Groups, Producers, and Consumers for Kafka Instances?
Will a Consumer Group Without Active Consumers Be Automatically Deleted in 14 Days?
Why Do I See a Deleted Consumer Group on Kafka Manager?
Messages
What Is the Maximum Size of a Message that Can be Created?
Why Does Message Poll Often Fail During Rebalancing?
Why Can't I Query Messages on the Console?
What Can I Do If Kafka Messages Are Accumulated?
Why Do Messages Still Exist After the Retention Period Elapses?
Do Kafka Instances Support Delayed Message Delivery?
How Do I View the Number of Accumulated Messages?
Why Is the Message Creation Time Displayed as Year 1970?
Kafka Manager
Can I Configure a Kafka Manager Account to Be Read-Only?
Why Can't I See Broker Information After Logging In to Kafka Manager?
Yikes! Insufficient partition balance when creating topic : projectman_project_enterprise_project Try again.
Can I Query the Body of a Message by Using Kafka Manager?
Can I Change the Port of the Kafka Manager Web UI?
Which Topic Configurations Can Be Modified on Kafka Manager?
Why Is Information Displayed on Kafka Manager Inconsistent with Cloud Eye Monitoring Data?
How Do I Change a Partition Leader for a Topic in Kafka Manager?
Monitoring & Alarm
Why Can't I View the Monitoring Data?
Why Is the Monitored Number of Accumulated Messages Inconsistent with the Message Quantity Displayed on the Kafka Console?
Why Is a Consumer Group Still on the Monitoring Page After Being Deleted?
Troubleshooting
Troubleshooting Kafka Connection Exceptions
Troubleshooting 6-Min Latency Between Message Creation and Retrieval
Troubleshooting Message Creation Failures
Troubleshooting Topic Deletion Failures
Troubleshooting Failure to Log In to Kafka Manager in Windows
Troubleshooting Error "Topic {{topic_name}} not present in metadata after 60000 ms" During Message Production or Consumption
Videos
More Documents
User Guide (ME-Abu Dhabi Region)
Service Overview
What Is DMS for Kafka?
Product Advantages
Application Scenarios
Specifications
Comparing Kafka and RabbitMQ
Comparing DMS for Kafka and Open-Source Kafka
Notes and Constraints
Related Services
Basic Concepts
Permissions Management
Billing
Permissions Management
Creating a User and Granting DMS for Kafka Permissions
DMS for Kafka Custom Policies
Preparing Required Resources
Buying an Instance
Accessing a Kafka Instance
Accessing a Kafka Instance Without SASL
Accessing a Kafka Instance with SASL
Connecting to Kafka Manager and Viewing Kafka Information
Managing Instances
Modifying Instance Specifications
Viewing an Instance
Restarting an Instance
Deleting an Instance
Modifying the Information About an Instance
Configuring Public Access
Resetting Kafka Manager Password
Restarting Kafka Manager
Managing Instance Tags
Viewing Background Tasks
Managing Topics
Creating a Topic
Deleting a Topic
Modifying Topic Aging Time
Changing Partition Quantity
Modifying Synchronous Replication and Flushing Settings
Viewing Sample Code
Exporting Topics
Managing Messages
Querying Messages
Managing Users
Creating a SASL_SSL User
Granting Permissions to a SASL_SSL User
Resetting the SASL_SSL Password
Deleting a SASL_SSL User
Managing Consumer Groups
Querying Consumer Group Details
Deleting a Consumer Group
Resetting the Consumer Offset
Viewing Consumer Connection Addresses
Modifying Kafka Parameters
Quotas
Monitoring
Viewing Metrics
Kafka Metrics
Configuring Alarm Rules
Auditing
Operations Logged by CTS
Viewing Audit Logs
FAQs
Instances
Why Can't I Select Two AZs?
Why Can't I View the Subnet and Security Group Information When Creating a DMS Instance?
How Do I Select Storage Space for a Kafka Instance?
How Do I Choose Between High I/O and Ultra-high I/O?
Which Capacity Threshold Policy Should I Use?
Which Kafka Versions Are Supported?
What Is the ZooKeeper Address of a Kafka Instance?
Are Kafka Instances in Cluster Mode?
Can I Modify the Connection Address for Accessing a Kafka Instance?
How Long Are Kafka SSL Certificates Valid for?
How Do I Synchronize Data from One Kafka Instance to Another?
How Do I Change the SASL_SSL Setting of a Kafka Instance?
Will a Kafka Instance Be Restarted After Its Enterprise Project Is Modified?
Are Kafka Brokers and ZooKeeper Deployed on the Same VM or on Different VMs?
Which Cipher Suites Are Supported by Kafka?
Can I Change an Instance from Single-AZ Deployment to Multi-AZ Deployment?
Does DMS for Kafka Support Cross-AZ Disaster Recovery? Where Can I View the AZs Configured for an Existing Instance?
Do Kafka Instances Support Disk Encryption?
Does Specification Modification Affect Services?
Can I Change the VPC and Subnet After a Kafka Instance Is Created?
Where Can I Find Kafka Streams Use Cases?
Can I Upgrade Kafka Instances?
Why Is the Version on the Console Different from That in Kafka Manager?
How Do I Bind an EIP Again?
Connections
Troubleshooting Kafka Connection Exceptions
How Do I Select and Configure a Security Group?
Can I Access a Kafka Instance Over a Public Network?
How Many Connection Addresses Does a Kafka Instance Have by Default?
Do Kafka Instances Support Cross-Region Access?
Do Kafka Instances Support Cross-Subnet Access?
Does DMS for Kafka Support Authentication with Kerberos?
Does DMS for Kafka Support Password-Free Access?
Obtaining Kafka Clients
Does DMS for Kafka Support Authentication on Clients by the Server?
Can I Use PEM SSL Truststore When Connecting to a Kafka Instance with SASL_SSL Enabled?
What Are the Differences Between JKS and CRT Certificates?
Which TLS Version Does DMS for Kafka Support?
Is There a Limit on the Number of Client Connections to a Kafka Instance?
How Many Connections Are Allowed from Each IP Address?
Topics and Partitions
Is There a Limit on the Number of Topics in a Kafka Instance?
Why Is Partition Quantity Limited?
Can I Change the Partition Quantity?
Why Do I Fail to Create Topics?
Do Kafka Instances Support Batch Importing Topics or Automatic Topic Creation?
Why Do Deleted Topics Still Exist?
Can I View the Disk Space Used by a Topic?
Can I Add ACL Permissions for Topics?
What Should I Do If Kafka Storage Space Is Used Up Because Retrieved Messages Are Not Deleted?
How Do I Increase the Partition Quantity?
Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?
How Do I Disable Automatic Topic Creation?
Can I Delete Unnecessary Topics in a Consumer Group?
What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?
Why Does an Instance Contain Default Topics __trace and __consumer_offsets?
Consumer Groups
Do I Need to Create Consumer Groups, Producers, and Consumers for Kafka Instances?
Do I Need to Unsubscribe from a Topic Before Deleting a Consumer Group?
Will a Consumer Group Without Active Consumers Be Automatically Deleted in 14 Days?
Why Do I See a Deleted Consumer Group on Kafka Manager?
Messages
What Is the Maximum Size of a Message that Can be Created?
Why Does Message Poll Often Fail During Rebalancing?
Why Can't I Query Messages on the Console?
What Can I Do If Kafka Messages Are Accumulated?
Why Do Messages Still Exist After the Retention Period Elapses?
Do Kafka Instances Support Delayed Message Delivery?
How Do I View the Number of Accumulated Messages?
Why Is the Message Creation Time Displayed as Year 1970?
Kafka Manager
Can I Configure a Kafka Manager Account to Be Read-Only?
Why Can't I See Broker Information After Logging In to Kafka Manager?
Yikes! Insufficient partition balance when creating topic : projectman_project_enterprise_project Try again.
Can I Query the Body of a Message by Using Kafka Manager?
Can I Change the Port of the Kafka Manager Web UI?
Which Topic Configurations Can Be Modified on Kafka Manager?
Why Is Information Displayed on Kafka Manager Inconsistent with Cloud Eye Monitoring Data?
How Do I Change a Partition Leader for a Topic in Kafka Manager?
Monitoring & Alarm
Why Can't I View the Monitoring Data?
Why Is the Monitored Number of Accumulated Messages Inconsistent with the Message Quantity Displayed on the Kafka Console?
Why Is a Consumer Group Still on the Monitoring Page After Being Deleted?
Troubleshooting
Troubleshooting Kafka Connection Exceptions
Troubleshooting 6-Min Latency Between Message Creation and Retrieval
Troubleshooting Message Creation Failures
Troubleshooting Topic Deletion Failures
Troubleshooting Failure to Log In to Kafka Manager in Windows
Troubleshooting Error "Topic {{topic_name}} not present in metadata after 60000 ms" During Message Production or Consumption
Change History
API Reference (ME-Abu Dhabi Region)
Before You Start
Overview
API Calling
Endpoints
Constraints
Concepts
API Overview
Calling APIs
Making an API Request
Authentication
Response
Getting Started
APIs for Managing Instances
Creating an Instance
Querying an Instance
Modifying an Instance
Deleting an Instance
Restarting or Deleting Instances in Batches
Querying All Instances
Creating a Topic in a Kafka Instance
Querying a Topic in a Kafka Instance
Deleting Topics in a Kafka Instance in Batches
Other APIs
Querying AZ Information
Querying Product Specifications
Querying Maintenance Time Windows
Permissions Policies and Supported Actions
Appendix
Status Code
Error Codes
Instance Status
Obtaining a Project ID
Obtaining the Account Name and Account ID
Change History
User Guide (Paris and Amsterdam Regions)
Service Overview
What Is DMS for Kafka?
Product Advantages
Application Scenarios
Specifications
Comparing Kafka Instances and DMS Advanced Queues
Comparing DMS for Kafka and Open-Source Kafka
Notes and Constraints
Related Services
Basic Concepts
Preparing Required Resources
Creating an Instance
Accessing a Kafka Instance
Accessing a Kafka Instance Without SASL
Accessing a Kafka Instance with SASL
Connecting to Kafka Manager and Viewing Kafka Information
Managing Instances
Viewing an Instance
Restarting an Instance
Deleting an Instance
Modifying the Information About an Instance
Configuring Public Access
Resetting Kafka Password
Resetting Kafka Manager Password
Managing Instance Tags
Viewing Background Tasks
Managing Topics
Creating a Topic
Deleting a Topic
Modifying Topic Aging Time
Changing Partition Quantity
Modifying Synchronous Replication and Flushing Settings
Viewing Sample Code
Exporting Topics
Managing Messages
Querying Messages
Managing Users
Creating a SASL_SSL User
Granting Permissions to a SASL_SSL User
Resetting the SASL_SSL Password
Deleting a SASL_SSL User
Managing Consumer Groups
Querying Consumer Group Details
Deleting a Consumer Group
Resetting the Consumer Offset
Viewing Consumer Connection Addresses
Quotas
Monitoring
Viewing Metrics
Kafka Metrics
Auditing
Operations Logged by CTS
Viewing Audit Logs
FAQs
Instances
Why Can't I Select Two AZs?
Why Can't I View the Subnet and Security Group Information When Creating a DMS Instance?
How Do I Select Storage Space for a Kafka Instance?
How Do I Choose Between High I/O and Ultra-high I/O?
Which Capacity Threshold Policy Should I Use?
Which Kafka Versions Are Supported?
What Is the ZooKeeper Address of a Kafka Instance?
Are Kafka Instances in Cluster Mode?
Can I Modify the Connection Address for Accessing a Kafka Instance?
How Long Are Kafka SSL Certificates Valid for?
How Do I Synchronize Data from One Kafka Instance to Another?
How Do I Change the SASL_SSL Setting of a Kafka Instance?
Are Kafka Brokers and ZooKeeper Deployed on the Same VM or on Different VMs?
Which Cipher Suites Are Supported by Kafka?
Can I Change an Instance from Single-AZ Deployment to Multi-AZ Deployment?
Does DMS for Kafka Support Cross-AZ Disaster Recovery? Where Can I View the AZs Configured for an Existing Instance?
Do Kafka Instances Support Disk Encryption?
Can I Change the VPC and Subnet After a Kafka Instance Is Created?
Where Can I Find Kafka Streams Use Cases?
Can I Upgrade Kafka Instances?
Why Is the Version on the Console Different from That in Kafka Manager?
How Do I Bind an EIP Again?
Connections
Troubleshooting Kafka Connection Exceptions
How Do I Select and Configure a Security Group?
Can I Access a Kafka Instance Over a Public Network?
How Many Connection Addresses Does a Kafka Instance Have by Default?
Do Kafka Instances Support Cross-Region Access?
Do Kafka Instances Support Cross-Subnet Access?
Does DMS for Kafka Support Authentication with Kerberos?
Does DMS for Kafka Support Password-Free Access?
Obtaining Kafka Clients
How Do I Obtain the Public Access Address After Public Access Is Enabled?
Does DMS for Kafka Support Authentication on Clients by the Server?
Can I Use PEM SSL Truststore When Connecting to a Kafka Instance with SASL_SSL Enabled?
What Are the Differences Between JKS and CRT Certificates?
Which TLS Version Does DMS for Kafka Support?
Is There a Limit on the Number of Client Connections to a Kafka Instance?
How Many Connections Are Allowed from Each IP Address?
Can I Change the Private Network Addresses of a Kafka Instance?
Topics and Partitions
Is There a Limit on the Number of Topics in a Kafka Instance?
Why Is Partition Quantity Limited?
Can I Change the Partition Quantity?
Why Do I Fail to Create Topics?
Do Kafka Instances Support Batch Importing Topics or Automatic Topic Creation?
Why Do Deleted Topics Still Exist?
Can I Add ACL Permissions for Topics?
What Should I Do If Kafka Storage Space Is Used Up Because Retrieved Messages Are Not Deleted?
Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?
How Do I Disable Automatic Topic Creation?
Can I Delete Unnecessary Topics in a Consumer Group?
What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?
Why Does an Instance Contain Default Topics __trace and __consumer_offsets?
Consumer Groups
Do I Need to Create Consumer Groups, Producers, and Consumers for Kafka Instances?
Do I Need to Unsubscribe from a Topic Before Deleting a Consumer Group?
Will a Consumer Group Without Active Consumers Be Automatically Deleted in 14 Days?
Why Do I See a Deleted Consumer Group on Kafka Manager?
Messages
What Is the Maximum Size of a Message that Can be Created?
Why Does Message Poll Often Fail During Rebalancing?
Why Can't I Query Messages on the Console?
Why Do Messages Still Exist After the Retention Period Elapses?
Do Kafka Instances Support Delayed Message Delivery?
How Do I View the Number of Accumulated Messages?
Why Is the Message Creation Time Displayed as Year 1970?
Kafka Manager
Can I Configure a Kafka Manager Account to Be Read-Only?
Why Can't I See Broker Information After Logging In to Kafka Manager?
Yikes! Insufficient partition balance when creating topic : projectman_project_enterprise_project Try again.
Can I Query the Body of a Message by Using Kafka Manager?
Can I Change the Port of the Kafka Manager Web UI?
Which Topic Configurations Can Be Modified on Kafka Manager?
How Do I Change a Partition Leader for a Topic in Kafka Manager?
Monitoring & Alarm
Why Can't I View the Monitoring Data?
Why Is the Monitored Number of Accumulated Messages Inconsistent with the Message Quantity Displayed on the Kafka Console?
Why Is a Consumer Group Still on the Monitoring Page After Being Deleted?
Troubleshooting
Troubleshooting Kafka Connection Exceptions
Troubleshooting 6-Min Latency Between Message Creation and Retrieval
Troubleshooting Topic Deletion Failures
Troubleshooting Failure to Log In to Kafka Manager in Windows
Troubleshooting Error "Topic {{topic_name}} not present in metadata after 60000 ms" During Message Production or Consumption
Change History
API Reference (Paris and Amsterdam Regions)
Before You Start
Overview
API Calling
Endpoints
Concepts
API Overview
Calling APIs
Making an API Request
Authentication
Returned Values
Getting Started
APIs V2 (Recommended)
Lifecycle Management
Creating an Instance
Listing All Instances
Querying an Instance
Deleting an Instance
Modifying Instance Information
Batch Restarting or Deleting Instances
Instance Management
Resetting the Password
Resetting Kafka Manager Password
Configuring Automatic Topic Creation
Modifying the Private IP Address for Cross-VPC Access
Querying Kafka Cluster Metadata
Querying Consumer Group Details
Resetting Consumer Group Offset to the Specified Position
Querying Coordinator Details of a Kafka Instance
Adding Partitions to a Topic for a Kafka Instance
Reassigning Replicas of a Topic for a Kafka Instance
Querying the Disk Usage Status of Topics
Querying All Consumer Groups
Topic Management
Creating a Topic for a Kafka Instance
Listing Topics of a Kafka Instance
Modifying Topics of a Kafka Instance
Batch Deleting Topics of a Kafka Instance
Querying Topic Details
User Management
Querying the User List
Creating a User
Deleting Users in Batches
Resetting a User Password
Querying User Permissions
Granting User Permissions
Message Query
Querying Messages
Querying a Message with a Specified Offset
Querying a Message with a Specified Time Period
Querying Offset of the Earliest Message in a Partition
Querying Offset of the Latest Message in a Partition
Background Task Management
Listing Background Tasks
Querying a Background Task
Deleting a Background Task
Other APIs
Listing Maintenance Time Windows
Listing AZ Information
Querying Product Specifications List
Out-of-Date APIs
API V1
APIs for Managing Instances
Creating an Instance
Querying an Instance
Modifying an Instance
Deleting an Instance
Restarting or Deleting Instances in Batches
Querying All Instances
Creating a Topic in a Kafka Instance
Querying a Topic in a Kafka Instance
Deleting Topics in a Kafka Instance in Batches
Other APIs
Querying AZ Information
Querying Product Specifications
Querying Maintenance Time Windows
Appendix
Status Code
Error Codes
Instance Status
Obtaining a Project ID
Obtaining the Account Name and Account ID
Change History
Developer Guide (Paris and Amsterdam Regions)
Overview
Collecting Connection Information
Java
Configuring Kafka Clients in Java
Setting Up the Java Development Environment
Python
Obtaining Kafka Clients
Recommendations on Client Usage
Change History
User Guide (Kuala Lumpur Region)
Service Overview
What Is DMS for Kafka?
Product Advantages
Application Scenarios
Specifications
Comparing Kafka and RabbitMQ
Comparing DMS for Kafka and Open-Source Kafka
Notes and Constraints
Related Services
Basic Concepts
Permissions Management
Permissions Management
Creating a User and Granting DMS for Kafka Permissions
DMS for Kafka Custom Policies
Preparing Required Resources
Buying an Instance
Accessing a Kafka Instance
Accessing a Kafka Instance Without SASL
Accessing a Kafka Instance with SASL
Connecting to Kafka Manager and Viewing Kafka Information
Managing Instances
Modifying Instance Specifications
Viewing an Instance
Restarting an Instance
Deleting an Instance
Modifying the Information About an Instance
Resetting SASL_SSL User Password
Resetting Kafka Manager Password
Restarting Kafka Manager
Managing Instance Tags
Viewing Background Tasks
Managing Topics
Creating a Topic
Deleting a Topic
Modifying Topic Aging Time
Changing Partition Quantity
Managing Messages
Querying Messages
Managing Users
Creating a SASL_SSL User
Granting Permissions to a SASL_SSL User
Managing Consumer Groups
Deleting a Consumer Group
Viewing Consumer Connection Addresses
Modifying Kafka Parameters
Quotas
Monitoring
Kafka Metrics
Configuring Alarm Rules
Viewing Metrics
Auditing
Operations Logged by CTS
Viewing Audit Logs
FAQs
Instances
Why Can't I Select Two AZs?
Why Can't I View the Subnet and Security Group Information When Creating a DMS Instance?
How Do I Select Storage Space for a Kafka Instance?
How Do I Choose Between High I/O and Ultra-high I/O?
Which Capacity Threshold Policy Should I Use?
Which Kafka Versions Are Supported?
What Is the ZooKeeper Address of a Kafka Instance?
Are Kafka Instances in Cluster Mode?
Can I Modify the Connection Address for Accessing a Kafka Instance?
How Long Are Kafka SSL Certificates Valid for?
How Do I Synchronize Data from One Kafka Instance to Another?
How Do I Change the SASL_SSL Setting of a Kafka Instance?
Will a Kafka Instance Be Restarted After Its Enterprise Project Is Modified?
Are Kafka Brokers and ZooKeeper Deployed on the Same VM or on Different VMs?
Which Cipher Suites Are Supported by Kafka?
Can I Change an Instance from Single-AZ Deployment to Multi-AZ Deployment?
Does DMS for Kafka Support Cross-AZ Disaster Recovery? Where Can I View the AZs Configured for an Existing Instance?
Do Kafka Instances Support Disk Encryption?
Does Specification Modification Affect Services?
Can I Change the VPC and Subnet After a Kafka Instance Is Created?
Where Can I Find Kafka Streams Use Cases?
Can I Upgrade Kafka Instances?
Why Is the Version on the Console Different from That in Kafka Manager?
Connections
Troubleshooting Kafka Connection Exceptions
How Do I Select and Configure a Security Group?
Can I Access a Kafka Instance Over a Public Network?
How Many Connection Addresses Does a Kafka Instance Have by Default?
Do Kafka Instances Support Cross-Region Access?
Do Kafka Instances Support Cross-Subnet Access?
Why Can't I Access Kafka Using SSL from a Go Client?
What If Certificates Fail to Be Loaded for SASL Connection?
Does DMS for Kafka Support Password-Free Access?
Obtaining Kafka Clients
Does DMS for Kafka Support Authentication on Clients by the Server?
Can I Use PEM SSL Truststore When Connecting to a Kafka Instance with SASL_SSL Enabled?
What Are the Differences Between JKS and CRT Certificates?
Which TLS Version Does DMS for Kafka Support, 1.0, 1.1, or 1.2?
Is There a Limit on the Number of Connections to a Kafka Instance?
How Many Connections Are Allowed from Each IP Address?
Topics and Partitions
Is There a Limit on the Number of Topics in a Kafka Instance?
Why Is Partition Quantity Limited?
Can I Reduce the Partition Quantity?
Why Do I Fail to Create Topics?
Do Kafka Instances Support Batch Importing Topics or Automatic Topic Creation?
Why Do Deleted Topics Still Exist?
Can I View Disk Space Used by a Topic?
Can I Add ACL Permissions for Topics?
How Do I Create a Topic?
What Should I Do If Kafka Storage Space Is Used Up Because Retrieved Messages Are Not Deleted?
What Can I Do If Disk Usage Is as High as 96%?
How Do I Increase the Partition Quantity?
Will a Kafka Instance Be Restarted After Its Automatic Topic Creation Setting Is Modified?
How Do I Disable Automatic Topic Creation?
Can I Delete Unnecessary Topics in a Consumer Group?
What Can I Do If a Consumer Fails to Retrieve Messages from a Topic Due to Insufficient Permissions?
Why Does an Instance Contain Default Topics __trace and __consumer_offsets?
Consumer Groups
Do I Need to Create Consumer Groups, Producers, and Consumers for Kafka Instances?
Do I Need to Unsubscribe from a Topic Before Deleting a Consumer Group?
Will a Consumer Group Without Active Consumers Be Deleted in 14 Days?
Why Do I See a Deleted Consumer Group on Kafka Manager?
Messages
What Is the Maximum Size of a Message that Can be Created?
Why Does Message Poll Often Fail During Rebalancing?
Why Can't I Query Messages on the Console?
What Can I Do If Kafka Messages Are Accumulated?
Why Do Messages Still Exist After the Retention Period Elapses?
Do Kafka Instances Support Delayed Message Delivery?
Does the Message Query Function on the Console Show the Replica Message Quantity?
How Do I View Accumulated Messages?
Why Is the Message Creation Time Displayed as Year 1970?
Kafka Manager
Can I Configure a Kafka Manager Account to Be Read-Only?
Why Can't I See Broker Information After Logging In to Kafka Manager?
Yikes! Insufficient partition balance when creating topic : projectman_project_enterprise_project Try again.
Can I Query the Body of a Message by Using Kafka Manager?
Can I Change the Port of the Kafka Manager Web UI?
Which Topic Configurations Can Be Modified on Kafka Manager?
Why Is Information Displayed on Kafka Manager Inconsistent with Cloud Eye Monitoring Data?
How Do I Change a Partition Leader for a Topic in Kafka Manager?
Monitoring & Alarm
Why Can't I View the Monitoring Data?
How Do I Configure Alarms for a Kafka Instance?
Why Is the Monitored Number of Accumulated Messages Inconsistent with the Message Quantity Displayed on the Kafka Console?
Why Is a Consumer Group Still on the Monitoring Page After Being Deleted?
Change History
API Reference (Kuala Lumpur Region)
Before You Start
Overview
API Calling
Endpoints
Constraints
Concepts
API Overview
Calling APIs
Making an API Request
Authentication
Response
Getting Started
APIs for Managing Instances
Creating an Instance
Querying an Instance
Modifying an Instance
Deleting an Instance
Restarting or Deleting Instances in Batches
Querying All Instances
Creating a Topic in a Kafka Instance
Querying a Topic in a Kafka Instance
Deleting Topics in a Kafka Instance in Batches
Other APIs
Querying AZ Information
Querying Product Specifications
Querying Maintenance Time Windows
Permissions Policies and Supported Actions
Appendix
Status Code
Error Codes
Instance Status
Obtaining a Project ID
Obtaining the Domain Name and Domain ID
Change History
General Reference
Glossary
Service Level Agreement
Endpoints
Permissions