Updated on 2024-03-18 GMT+08:00

Creating a Data Connection on the Flink Web UI

Scenario

Different data services can be accessed through data connections. Currently, FlinkServer supports HDFS, Kafka, and Redis data connections.

Creating a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. Click Create Data Connection. On the displayed page, select a data connection type, enter information by referring to Table 1, and click OK.

    Table 1 Parameters for creating a data connection

    Parameter

    Description

    Example Value

    Data Connection Type

    Type of the data connection, which can be HDFS, Kafka, or Redis.

    -

    Data Connection Name

    Name of the data connection, which can contain a maximum of 100 characters. Only letters, digits, and underscores (_) are allowed.

    -

    Cluster Connection

    Cluster connection name in configuration management.

    This parameter is mandatory for HDFS data connections and Redis data connections whose authentication type is KERBEROS.

    -

    Kafka broker

    Connection information about Kafka broker instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Kafka data connections.

    192.168.0.1:21005,192.168.0.2:21005

    Redis Deployment Method

    Redis deployment mode. Currently, only Cluster is supported.

    This parameter is mandatory for Redis data connections.

    Cluster

    Redis Server List

    Connection information about Redis instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Redis data connections.

    192.168.0.1:22400,192.168.0.2:22400

    Authentication Mode

    • SIMPLE: indicates that the connected service is in non-security mode and does not need to be authenticated.
    • KERBEROS: indicates that the connected service is in security mode and the Kerberos protocol for security authentication is used for authentication.

    This parameter is mandatory for Redis data connections.

    -

Editing a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. In the Operation column of the item to be modified, click Edit. On the displayed page, modify the connection information by referring to Table 1 and click OK.

Testing a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. In the Operation column of the item to be tested, click Test.

Searching for a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. In the upper right corner of the page, you can search for a data connection by name.

Deleting a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. In the Operation column of the item to be deleted, click Delete, and click OK in the displayed page.