Help Center/ MapReduce Service/ Component Operation Guide (LTS) (Ankara Region)/ Using Flink/ Configuring and Developing a Flink Visualization Job/ Creating a Data Connection
Updated on 2024-11-29 GMT+08:00
View PDF
Share

Creating a Data Connection

Scenario

You can use data connections to access different data services. Currently, FlinkServer supports HDFS, Redis, and Kafka data connections.

Creating a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. Click Create Data Connection. On the displayed page, select a data connection type, enter information by referring to Table 1, and click OK. After the data connection is created, you can edit, test, or delete the data connection in the Operation column.

    Table 1 Parameters for creating a data connection

    Parameter

    Description

    Example Value

    Data Connection Type

    Type of the data connection, which can be HDFS, Redis, or Kafka.

    -

    Data Connection Name

    Name of the data connection.

    -

    Cluster Connection

    Cluster connection name in configuration management.

    This parameter is mandatory for HDFS data connections and Redis data connections whose authentication type is KERBEROS.

    -

    Kafka broker

    Connection information about Kafka broker instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Kafka data connections.

    192.168.0.1:21005,192.168.0.2:21005

    Redis Deployment Method

    Redis deployment mode. Currently, only Cluster is supported.

    This parameter is mandatory for Redis data connections.

    Cluster

    Redis Server List

    Connection information about Redis instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Redis data connections.

    192.168.0.1:22400,192.168.0.2:22400

    Authentication Mode
    • SIMPLE: indicates that the connected service is in non-security mode and does not need to be authenticated.
    • KERBEROS: indicates that the connected service is in security mode and the Kerberos protocol for security authentication is used for authentication.

    This parameter is mandatory for Redis data connections.

    -

    Redis SSL ON

    Whether to enable SSL.

    This parameter is mandatory for Redis data connections.

    -