(Optional) Configuring the Post-Integration Operation
Overview
After a scheduled data integration task is successfully executed, messages can be sent to Kafka or MRS Kafka based on the configuration. In this way, a third-party platform (for example, DataArts Studio) can subscribe to Kafka or MRS Kafka to obtain messages and determine whether to perform data extraction.
This section describes how to configure message sending after a task is executed. If message sending is not required, you do not need to configure message sending.
Prerequisites
- The Kafka and MRS Kafka data sources have been created under the corresponding application. For details, see Connecting to a Kafka Data Source and Connecting to an MRS Kafka Data Source.
- A topic has been created and granted with the publish and subscribe permissions. For details about how to create a topic and grant permissions, see Message Integration Guide.
Procedure
- On the Create Task page, configure post-integration operation information.
Table 1 Parameters for configuring the post-integration operation Parameter
Description
Action
Determine whether to send a message after the task is executed.
Do no send messages: No message is sent after the task is successfully executed.
Send messages to Kafka: A message will be sent to Kafka after the task is successfully executed.
Send messages to MRS Kafka: A message will be sent to MRS Kafka after the task is successfully executed.
FDI task: After an FDI task is complete, a maximum of five common scheduled tasks can be automatically or manually scheduled at the same time.
Application
Select the integration application.
Data Source
Select the data source type that is the same as that selected for Action.
For example, if Send messages to Kafka is selected for Action, select Kafka for Data Source.
Topic
Select the topic to which the message is to be sent.
Custom Message Content
Customize the content of the message to be sent by using ${} to reference variables. The supported variables are as follows:
taskName: task name.
dataCount: data volume.
targetTable: destination table.
dataSize: data size.
For example, the content ${taskName} indicates that only the task name is sent.
FDI Task
Mandatory when Action is set to FDI task.
Select the next FDI task to be executed. If the selected FDI task is running when the current task is complete, the scheduling is skipped.
- Click Create.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot