Configuring Basic Information

Overview

You can convert data among different data sources by creating a data integration task on ROMA Connect. Based on your configured data integration task, ROMA Connect determines how to integrate data in a specific data table at the source to a data table at the destination.

A data integration task includes basic information, schedule (optional), source information, destination information, mapping information, fault information storage (optional), and post-integration operation (optional). This topic describes how to configure basic information and create a schedule for a data integration task.

Prerequisites

• The source and destination data sources have been connected to ROMA Connect. (For details, see Connecting to Data Sources.)
• ROMA Connect has the permission to write data to the destination.
• If you need to configure data storage for abnormal synchronization is abnormal, ensure that the OBS data source has been connected. For details, see Connecting to an OBS Data Source.

Configuring Basic Information

1. Log in to the ROMA Connect console. On the Instances page, click View Console next to a specific instance.
2. In the navigation pane on the left, choose Fast Data Integration > Task Management. On the page displayed, click Create Task.
3. On the Create Task page, configure basic task information.

   Table 1 Basic task information

   Parameter	Description
   Task Name	Enter a task name. It is recommended that you enter a name based on naming rules to facilitate search.
   Description	Enter a brief description of the task.
   Integration Mode	Select Scheduled as the mode used for data integration. Scheduled: A data integration task is executed according to the schedule to integrate data from the source to the destination. Real-Time: The data integration task continuously detects updates to the data at the source and integrates updates to the destination in real time. The data integration mode varies depending on the data source. For details, see Table 1.
   Tag	Add a tag to classify tasks for quick search. You can select an existing tag for association. If no tag is available, click Add Tag to add a new tag. The new tag is saved when the task is saved. You can search for the tag when creating a task.

4. Proceed to the next step.
   • If Integration Mode is set to Scheduled, create a schedule.
   • If Integration Mode is set to Real-Time, configure source information.

(Optional) Creating a Schedule

If Integration Mode of a task is set to Scheduled, you need to configure schedule information for the task.

• If you need to modify a schedule after a data integration task is created, stop the task first.
• If a large amount of data needs to be synchronized and the task execution interval is short, the next task scheduling time may arrive before the previous task scheduling is complete. In this case, ROMA Connect suspends new scheduling and waits until the previous scheduling is complete.

1. On the Create Task page, configure schedule information. ROMA Connect provides two methods for configuring a schedule:
   • GUI configuration

     Currently, only the simple periodic configuration is supported, for example, every few minutes, hours, or days.

     Figure 1 GUI configuration
     

     Table 2 Simple GUI configuration

     Parameter	Description
     QuartZ Cron Expression	Select Do not use.
     Unit	Set the unit of the task execution period. The value can be Minute, Hour, Day, Week, or Month.
     Period	Set the task execution cycle. The value range varies depending on the value of Unit. For example, if Unit is set to Day and Period is set to 1, the data integration task is executed once a day.
     Effective Time	Specify the time at which you want the task to be executed. The task will be executed in the next scheduling period. For example, if Effective Time is set to 2020-2-2 02:02:02 and the scheduling period is one day, the task is executed for the first time at 02:02:02 on February 3, 2020.
     Description	Enter the description of the schedule.

   • Using QuartZ Cron expression

     The QuartZ Cron expression supports flexible schedules. For example, a task can be executed every 15 minutes from 01:00 to 04:00 every day based on the settings of the QuartZ Cron expression. Such a schedule cannot be implemented through simple GUI configuration, but using the QuartZ Cron expression.

     0 0/15 1-4 * * ?

     Figure 2 QuartZ Cron expression
     

     Table 3 Using QuartZ Cron expression

     Parameter	Description
     QuartZ Cron Expression	Select Use.
     Expression Schedule	Specify the QuartZ Cron expression for the schedule. Currently, ROMA Connect supports only minute-level schedules. The second in the expression is fixed to 0. For example, if a task needs to be executed every 15 minutes from 01:00 to 04:00 every day, the QuartZ Cron expression corresponding to the schedule is as follows: 0 0/15 1-4 * * ?
     Effective Time	Specify the time at which you want the task to be executed. The task will be executed in the subsequent scheduling period. For example, if Effective Time is set to 2020-2-2 02:02:02 and QuartZ Cron Expression is set to 0 0/15 1-4 * * ?, the task is executed for the first time at 02:15:00 on February 3, 2020.
     Description	Enter the description of the schedule.

2. After configuring the task schedule, proceed with Configuring Source Information.