Updated on 2024-05-07 GMT+08:00

Overview

GaussDB(DWS) is an online data processing database based on the cloud infrastructure and platform and helps you mine and analyze massive sets of data. DLI reads data of Flink jobs from GaussDB(DWS). GaussDB(DWS) database kernel is compliant with PostgreSQL. The PostgreSQL database can store data of more complex types and delivers space information services, multi-version concurrent control (MVCC), and high concurrency. It applies to location applications, financial insurance, and e-commerce.

For more information about GaussDB(DWS), see Data Warehouse Service Management Guide.

DLI Flink 1.15 now offers two GaussDB(DWS) connector options for accessing GaussDB data:
  • GaussDB(DWS)'s self-developed GaussDB(DWS) connector (recommended): This option focuses on the performance of and direct interaction with GaussDB(DWS), allowing users to easily and flexibly read and write data.

    You can use GaussDB(DWS)'s self-developed GaussDB(DWS) connector by creating UDFs. For details about how to create a UDF, see UDFs.

    For details about how to use the GaussDB(DWS) connector, see dws-connector-flink.

  • DLI's GaussDB(DWS) connector (discarded and not recommended): This option allows users to customize sink and source functions to meet specific data read and write needs.
    For how to use DLI's GaussDB(DWS) connector, see Table 1.
    Table 1 Supported GaussDB(DWS) connector types

    Type

    Instruction

    Source table

    GaussDB(DWS) Source Table (Not Recommended)

    Result table

    GaussDB(DWS) Result Table (Not Recommended)

    Dimension table

    GaussDB(DWS) Dimension Table (Not Recommended)