Help Center> ROMA Connect> User Guide> Business Flow Guide> Creating a Data Integration Task
View PDF

Creating a Data Integration Task

Overview

You can use a business flow to create a task for integrating and converting data from various cross-instance and cross-region sources.

Prerequisites

  • Data sources in the task can be connected.
  • You have the read and write permissions on the data sources in the task.

Procedure

  1. Log in to the HUAWEI CLOUD official website and go to the ROMA Connect home page.
  2. Click Business Flow.
  3. Click Business Flow Design in the upper right corner of the page and select a creation method. In this example, use Blank Template.
  4. Click Create Flow above Blank Template.

    You can also use the Data Integration template. The default data source type is Gauss200.

  5. Add a source node.
    1. Drag Integration Application under Basic Components on the left to the orchestration area.
    2. Click the Integration Application node to configure the node. For configuration details, see Integration Application. After the configuration is complete, click OK.
    3. In the Data Source area on the left, select a data source type, click , and drag a data source component as the source node to the integration application.
      • Before creating a data integration task, click All on the left and select Data integration from the drop-down list in the search box on the left to filter related components.
      • Only components filtered by using Data integration can be used for data integration tasks.
    4. Click the data source node and select the corresponding data source.

      If no data source is available, click Add to add one. For details, see Data Source Management.

  6. Add a destination node.
    1. Drag Integration Application under Basic Components on the left to the orchestration area.
    2. Add an integration application for the data source. For details, see 5.

    If data sources at the source and destination belong to the same integration application, the two sources can be placed on the same integration application node.

  7. Add a processor node.

    In the Processors area on the left, drag Task Scheduler to the orchestration area and configure scheduler parameters. For details, see Task Scheduler. After the configuration is complete, click OK.

  8. Connect and configure business flows.
    1. Connect the data source node at the source, task scheduler, and data source node at the destination in sequence.
      Figure 1 Connecting components
    2. Click the line between the source data node and task scheduler for configuration. For details about the configuration information, see Table 1. After the configuration is complete, click OK.
      Table 1 Data source at the source

      Data Source Type Supported by Scheduled Integration Tasks

      Data Source Type Supported by Real-Time Integration Tasks
    3. Click the line between the task scheduler and destination node and configure line parameters. For details, see Table 2. After the configuration is complete, click OK.
      Table 2 Data sources at the destination

      Data Source Type Supported by Both Real-Time and Scheduled Integration Tasks

      Data Source Type Supported Only by Real-Time Tasks

      OBS

      During data migration, if a primary key conflict occurs at the destination, data is automatically updated based on the primary key.

    4. Click in the upper right corner of the page and check whether configurations are correct.
      • If incorrect, reconfigure the nodes.
      • If correct, go to 10.
  9. Click Save in the upper right corner of the page to save the business flow configuration.
  10. Start a business flow.

    Click Start in the upper right corner of the page. If the task is started successfully, a success message will be displayed.

Parent topic: Business Flow Guide