Help Center/ Distributed Message Service for Kafka/ User Guide/ Migrating Data/ Migrating Data Using Smart Connect/ Enabling Smart Connect
Updated on 2024-10-10 GMT+08:00
View PDF
Share

Enabling Smart Connect

Smart Connect synchronizes data between Kafka and other cloud services (such as OBS) or between two Kafka instances for backup or migration.

Procedure for using Smart Connect:

  1. Enable Smart Connect.
  2. Create a Smart Connect task.

This section describes how to enable Smart Connect.

This function is unavailable for single-node instances.

Impact

Enabling Smart Connect incurs additional broker fees.

For example, if you enable Smart Connect for a kafka.4u8g.cluster instance, at least two more kafka.4u8g brokers will be created for Smart Connect and you need to pay for them.

Prerequisites

Procedure

  1. Log in to the console.
  2. Click in the upper left corner to select a region.

    Select the region where your Kafka instance is located.

  3. Click in the upper left corner and choose Middleware > Distributed Message Service (for Kafka) to open the console of DMS for Kafka.
  4. Enable Smart Connect using one of the following methods:

    • In the row containing the desired Kafka instance, choose More > Enable Smart Connect.
    • Click the desired Kafka instance to view its details. In the upper right corner, choose More > Enable Smart Connect.
    • Click the desired Kafka instance to view its details. Click next to Smart Connect.
    • Click the desired Kafka instance to view its details. In the navigation pane, choose Smart Connect. Click Enable Smart Connect.

  5. Click , enable Smart Connect, set 2–16 brokers as required, and click Next.

    By default, two brokers will be used. If synchronization traffic between two Kafka instances is estimated to be large, for example, greater than 50 MB/s, use more brokers.

  6. On the displayed Enabling Smart Connect for Kafka Instance page, ensure that Smart Connect is enabled and click Submit.

Follow-up Operations

Proceed to Replicating Kafka Instance Data, Dumping Kafka Data to Object Storage Service (OBS), to synchronize data between DMS for Kafka and other cloud services.