What's New

1

DWS connector

The DWS connector supports basic add, delete, modify, and query operations on DWS databases.

Commercial use

Connectors

2

Milvus connector

The Milvus connector supports basic add, delete, and query operations on Milvus databases.

Commercial use

Connectors

1

GaussDB connector

The GaussDB connector supports basic add, delete, modify, and query operations on GaussDB databases.

Commercial use

Connectors

2

XML verification processor

The XML format verification processor is used to verify XML files.

Commercial use

Processors

3

Upsert operation

You can use the upsert syntax to insert or update data. This approach effectively prevents conflicts with primary keys.

Commercial use

Creating a Composite Application

1

WASM script processor

The updated JS processor uses the WASM kernel and supports the ES2023 syntax.

Commercial use

Processors

2

FDI CDC real-time task comparison

The FDI CDC task comparison feature is now available. If you're concerned about data loss during CDC synchronization, you can use this function to compare data before and after synchronization.

Commercial use

Data Integration Guide

3

Huawei Cloud service connectors

More Huawei Cloud service connectors are available. Some existing connectors, such as CodeArts PerfTests, are updated.

Commercial use

Connectors

1

Resource management page optimization

• On the Resource page, instance resources are categorized as VM, container, or Site instances.
•  Package usage instructions have been added.

Commercial use

Viewing Details of an Instance

2

Incremental data loading for composite applications

The database connectors have been enhanced with an incremental data loading feature.

Commercial use

Connectors

3

CDC for composite applications

Four new database triggers are released. The data synchronization action is added to database connectors for CDC-based real-time synchronization.

Commercial use

Triggers

4

Functions for composite applications

Users can build composite applications using functions with variables, including math, string, encryption and decryption, date and time, encoding and decoding, and number system conversion.

Commercial use

Referencing Functions

1

Database connector configuration optimization

Database connector parameters such as WHERE and ORDER BY can be configured by selection.

Commercial use

Connectors

2

Composite application internationalization

The English console is available.

Commercial use

Creating a Composite Application with a Template

3

New action for the CodeArts Req connector

The action of creating an IPD raw requirement is added to the CodeArts Req connector.

Commercial use

Connectors

1

ROMA Connect RCU instances

The ROMA Compute Unit (RCU) is the capability compute unit of the new-version ROMA Connect instances. RCUs can be allocated to different integration capabilities, including FDI, APIC, MQS, LINK, and composable applications.

Commercial use

Creating an Instance

1

Batch import and export of composite applications

Users can manage composite applications in batches, reducing repetitive operations.

Commercial use

Importing and Exporting a Composite Application

2

Connector update

Functions can be referenced as variables.

Variables of a loop processor can be referenced.

Commercial use

Connectors

1

Visual guidance for beginners

The visual guidance on the workbench helps users get familiar with the layout, operations, and functions.

Commercial use

Creating a Composite Application

2

Data mapping processor enhancement

The data mapping processor supports XML, CSV, and multi-level JSON files.

Commercial use

Data Mapper

3

Connector improvement

Variables in a variable assignment form can be selected.

Commercial use

Connectors

4

Canvas optimization

The editing page can be resized.

The canvas layout is reorganized, with unified function areas and optimized visual design.

Commercial use

Creating a Composite Application

1

Custom output data structures

All connectors support custom output data structures.

Commercial use

Connectors

2

New connectors

GaussDB 100, ActiveMQ, Kafka, and Tencent Questionnaire.

Commercial use

Connectors

1

Optimized canvas

Nodes with wrong configurations are automatically marked on the editing canvas; node copy and paste are supported.

Commercial use

Creating a Composite Application

2

Call duration statistics in scheduling logs

The time consumed by the plug-in and data source is displayed in scheduling logs to optimize data source performance problem locating.

Commercial use

Viewing Data Integration Tasks

3

FDI private IP address on the details page

The private IP address of the FDI instance is displayed on the instance details page, facilitating private IP address authorization.

Commercial use

Viewing Details of an Instance

1

New connectors: DingTalk, Feishu, and Polarion

• The DingTalk connector is used to implement DingTalk functions by configuring a workflow.

• The Feishu connector is used to implement Lark functions by configuring a workflow.

• The Polarion connector is used to implement Polarion functions by configuring a workflow.

Commercial use

Connectors

2

Enhanced smart assistant

• ROMA Snap allows users to configure timers using natural languages.
• ROMA Snap supports component configuration on the canvas in an interactive manner.

Commercial use

Creating a Composite Application

1

Launch of the new ROMA Connect

• Composite application: Multiple applications are assembled through data and message integration, API orchestration, and event triggers to form a new composite application, implementing fast service replication and innovation.

• Connector: Multiple built-in connectors enable quick access of APIs, databases, and SaaS applications.

• Asset catalog: Various composite application templates accumulate industry assets and are easy to use.

Commercial use

User Guide (New)

2

ROMA Snap

AI enabled integration assistant. It captures the requirements for service integration based on user's natural language inputs using Natural Language Processing (NLP) machine learning, and generates a composite application.

Commercial use

ROMA Snap

3

Launch of the online debugging function

Task flows support online debugging with operations such as adding breakpoints, single-step execution, and resumption. Breakpoint running data and error information can be displayed in real time.

Commercial use

Debugging a Task Flow Online

4

Launch of the data mapping processor

The data mapping processor quickly maps data from the source to the destination.

Commercial use

Data Mapper

1

MQS Kafka v2.3.0 discontinued and v2.7 now available

When creating an instance, MQS engine v2.3.0 is no longer supported and replaced by v2.7.

Commercial use

Creating an Instance

Connecting to a Topic

1

APIC access control by account ID

APIC supports access control by account ID.

Commercial use

Configuring API Access Control

1

Up to 50 instance routes

A ROMA Connect instance supports up to 50 routes.

Commercial use

Viewing Details of an Instance

2

false value supported by MQTT device connection parameter cleanSession

When an MQTT device connects to LINK, cleanSession can be set to false.

Commercial use

Connecting MQTT Devices

3

Modifying the number of partitions of MQS topics

The number of partitions of MQS topic can be modified.

Commercial use

Creating a Topic

1

FDI flow tasks

Flow tasks can be easily created on the console.

Commercial use

Creating a Flow Data Integration Task

2

Passthrough from HL7 to Kafka

Passthrough is supported for data integration tasks from the HL7 data source to the Kafka data source.

Commercial use

Creating a Common Data Integration Task

3

Topic import/export in XLS or XLSX format

MQS topics can be imported and exported in XLS or XLSX format.

Commercial use

Importing and Exporting Topics

4

Data backend column conversion from nvarchar2 to string

The instance configuration parameter data_api_column_types_converted_to_string is added to specify whether a data backend supports the data column conversion from nvarchar2 to string.

Commercial use

Modifying Instance Configuration Parameters

5

DEFAULT group accessed by IP addresses that are not inbound access addresses of the current instance

The instance configuration parameter default_group_host_trustlist is added to specify whether APIs in the DEFAULT group can be accessed by IP addresses that are not inbound access addresses of the current instance.

Commercial use

Modifying Instance Configuration Parameters

1

BFS EDI Processor

The new BFS component EDI Processor exchanges and automatically processes data using a standard format between two computer systems.

Commercial use

EDI Processor

1

FDI monitoring information

An entry for viewing monitoring information is added to the FDI task management page. Click the Monitor button to switch to Cloud Eye to view task metrics of the current instance.

Commercial use

Monitoring Metrics

2

APIC HTTP/2 compatible

APIC API calling using HTTP/2

Commercial use

Calling an Open API

3

Description of OPC UA devices

On the ROMA Connect page, custom description for OPC UA devices is supported for easier node path management.

Commercial use

Connecting OPC UA Devices

4

OPC UA device data subscription

For devices connected to ROMA Connect using OPC UA, their data can be collected in subscription mode.

Commercial use

Connecting OPC UA Devices

5

ROMA 20.0 asset compatible

ROMA Connect supports ROMA 20.0 asset import.

Commercial use

Importing and Exporting Assets

6

Oracle 19c

The Oracle data source supports 19c, which can be used for common and composite tasks.

Commercial use

Data Sources Supported by ROMA Connect

1

HANA data source supported by APIC

Supported custom data backends of the HANA data source.

Commercial use

Connecting to a HANA Data Source

Creating a Data API

1

RocketMQ data source

Supported real-time read and write for the RocketMQ data source with SSL authentication disabled. RocketMQ is message-oriented middleware that delivers low latency, high reliability, high throughput, dynamic expansion, easy management, and abundant messaging functions.

Commercial use

Connecting to a RocketMQ Data Source

1

Parameter COOKIE for API policy backends

Added the COOKIE parameter as a condition for API backend policies on APIC.

Commercial use

Creating an API

1

Metadata generation for the API/Kafka/MQS data sources in FDI tasks

Supported the feature that JSON character strings can be automatically parsed into metadata when API/Kafka/MQS is used as the FDI task source.

Commercial use

Configuring Source Information

1

Enhanced task scheduling logs of composite tasks

Supported viewing real-time progress and latency of composite tasks every 5 minutes in the task scheduling logs.

Commercial use

Viewing Scheduling Details

2

Enhanced FDI capability for interconnecting with the SAP data source

Supported on-demand integration using user-defined functions (compatible with RFC_READ_TABLE2), time segments, and search criteria.

Commercial use

Configuring Source Information

1

Circuit breaker plug-in

Added the circuit breaker plug-in to the plug-in management module so that a backend service can be protected once it becomes abnormal.

Commercial use

Circuit Breaker Plug-in

1

Certificate management

Added the certificate management function to APIC. SSL certificates can be uploaded and managed independently.

Commercial use

SSL Certificate Management

1

HTTP response header management plug-in

Added the HTTP response header management plug-in to the plug-in management module for HTTP response header customization.

Commercial use

HTTP Response Header Management Plug-in

1

API plug-ins

Provides flexible extension capabilities for APIs through plug-ins.

Commercial use

Using Plug-ins

1

Business flows

Provides the no-code integration capability to integrate data and services across regions, instances, and applications.

Commercial use

Business Flow Guide

1

Client access control policies for APIs

As a protection mechanism for backend services, client access control policies control the client IP addresses that can access APIs.

Commercial use

Configuring a Client Access Control Policy

2

Optimized data integration page

The Task Management page of Fast Data Integration was optimized for better user experience.

Commercial use

Data Integration Guide

3

MQS data sources

The MQS data source type is added to separate the MQS data source from the Kafka data source.

Commercial use

Connecting to an MQS Data Source

1

API cascading

Two ROMA Connect instances in the same region or different regions can be cascaded. API calls between cascaded instances use a dedicated authentication channel to avoid authentication conflicts.

Commercial use

Configuring API Cascading

1

Gauss100 data source

The Gauss100 data source is added and used for data integration tasks.

Commercial use

Connecting to a Gauss100 Data Source

1

New data source types

The Gauss200, FTP, FI HDFS, FI Hive, FI Kafka and MRS Kafka data sources are supported and used for data integration tasks.

Commercial use

Connecting to an FTP Data Source

Connecting to an MRS Kafka Data Source

2

Client quota policies for APIs

As a protection mechanism for backend services, a client quota limits the total number of times that an API can be called by a client in a specified period.

Commercial use

Configuring a Client Quota Policy

3

Product management configuration optimization

The product configuration function of LINK is optimized to allow you to define services, attributes, and commands for a thing model.

Commercial use

Creating a Product

4

Simple authentication for APIs by using AppCode

APIs that use App authentication in APIC support simple authentication for API calling by using AppCode.

Commercial use

Creating an API

Adding AppCode

5

Real-time incremental data synchronization based on SQL Server CDC

A composite task can synchronize incremental data from the SQL Server database to other data sources in real time based on the SQL Server CDC capability.

Commercial use

Configuring SQL Server CDC

Creating a Composite Task

1

Renaming from ROMA to ROMA Connect

The name of the application and data integration platform is changed from ROMA to ROMA Connect.

Commercial use

ROMA Connect

1

Access parameters and green channels for API authorization

Access parameters can be added to the backend signature authentication information and sent to a backend service. The backend service then returns different response parameters based on the carried access parameters.

After the green channel function is enabled, addresses in the whitelist can call APIs without being authenticated, whereas addresses in the blacklist cannot call APIs.

Commercial use

Authorizing Applications to Call an API

2

Creating API groups by integration application

An API group can be created by integration application.

Commercial use

Creating an API Group

3

DB2 data sources

The DB2 data source type is supported and used for data integration tasks.

Commercial use

Connecting to a DB2 Data Source

1

IAM fine-grained authorization

ROMA supports fine-grained authorization on IAM to grant different ROMA permissions to IAM users.

Commercial use

ROMA Connect Custom Policies

1

Real-time incremental data synchronization based on MySQL CDC

A composite task can synchronize incremental data from the MySQL database to other data sources in real time based on the MySQL CDC capability.

Commercial use

Configuring the MySQL CDC (Binlog)

Creating a Composite Task

2

Customization of the data writing format when the destination is Redis

You can customize the format of data to be written when the destination of a data integration task is Redis.

Commercial use

Configuring Destination Information

1

A composite task supports the Kafka data source type as the destination.

The Kafka data source type can be used as the destination in a composite integration task.

Commercial use

Creating a Composite Task

2

Configuration management added for custom backends

The configuration management function is added to the custom backend of APIC, which allows you to configure private data such as passwords, certificates, and variables or global data, and reference the configuration in backend API scripts.

Commercial use

Creating a Function API

Adding Public Configurations for a Custom Backend

1

Page optimization for creating a data source

The page for creating a data source is optimized to improve user experience.

Commercial use

Data Source Management

2

Partition-based storage of MRS Hive data sources

You can set partition fields so that data can be written by partition when the destination of a data integration task is MRS Hive.

Commercial use

Mapping Configuration of MRS Hive Partition Fields

3

HL7 data sources support SSL authentication and whitelist.

SSL authentication can be enabled for data transmission between HL7 databases. When the HL7 functions as the data source, a whitelist can be configured to receive only data synchronized from the addresses in the whitelist.

Commercial use

Connecting to an HL7 Data Source

1

Real-time incremental data synchronization based on Oracle CDC through composite tasks

The composite task function is added to FDI to support synchronization of multiple data tables. With the Oracle CDC capability, FDI can synchronize incremental data from the Oracle database to other data sources in real time.

Commercial use

Configuring Oracle CDC (XStream)

Creating a Composite Task

2

Writing data to the MRS Hive data warehouse in overwrite mode

The service logic of data synchronization used when MRS Hive is used as the destination. By default, data is written to MRS Hive in append mode during incremental synchronization, and data is written to MRS Hive in overwrite mode during full synchronization.

Commercial use

Connecting to an MRS Hive Data Source

3

Oracle CDC independent of OGG license

The Oracle CDC function can be implemented in LogMiner mode, which does not depend on the OGG license.

Commercial use

Configuring Oracle CDC (LogMiner)

Creating a Composite Task

4

HANA data sources

The HANA data source type is supported and used for data integration tasks.

Commercial use

Connecting to a HANA Data Source

1

Unified data sources of APIC and FDI

A data source you created can be used by both FDI and APIC. In this way, you do not need to create the same data source on FDI and APIC separately.

Commercial use

Data Sources Supported by ROMA Connect

2

SFTP, ActiveMQ, and ArtemisMQ data sources

The SFTP, ActiveMQ, and ArtemisMQ data source types are supported and used for data integration tasks.

Commercial use

Connecting to an FTP Data Source

Connecting to an ActiveMQ Data Source

Connecting to an ArtemisMQ Data Source