(Optional) Configuring the Post-Integration Operation

Overview

After a scheduled data integration task is successfully executed, messages can be sent to Kafka or MRS Kafka based on the configuration. In this way, a third-party platform (for example, DataArts Studio) can subscribe to Kafka or MRS Kafka to obtain messages and determine whether to perform data extraction.

This section describes how to configure message sending after a task is executed. If message sending is not required, you do not need to configure message sending.

Prerequisites

• The Kafka and MRS Kafka data sources have been created under the corresponding application. For details, see Connecting to a Kafka Data Source and Connecting to an MRS Kafka Data Source.
• A topic has been created and granted with the publish and subscribe permissions. For details about how to create a topic and grant permissions, see Message Integration Guide.

Procedure

1. On the Create Task page, configure post-integration operation information.

   Table 1 Parameters for configuring the post-integration operation

   Parameter	Description
   Action	Determine whether to send a message after the task is executed. Do no send messages: No message is sent after the task is successfully executed. Send messages to Kafka: A message will be sent to Kafka after the task is successfully executed. Send messages to MRS Kafka: A message will be sent to MRS Kafka after the task is successfully executed. FDI task: After an FDI task is complete, a maximum of five common scheduled tasks can be automatically or manually scheduled at the same time.
   Application	Select the integration application.
   Data Source	Select the data source type that is the same as that selected for Action. For example, if Send messages to Kafka is selected for Action, select Kafka for Data Source.
   Topic	Select the topic to which the message is to be sent.
   Custom Message Content	Customize the content of the message to be sent by using ${} to reference variables. The supported variables are as follows: taskName: task name. dataCount: data volume. targetTable: destination table. dataSize: data size. For example, the content ${taskName} indicates that only the task name is sent.
   FDI Task	Mandatory when Action is set to FDI task. Select the next FDI task to be executed. If the selected FDI task is running when the current task is complete, the scheduling is skipped.

2. Click Create.