Updated on 2022-11-18 GMT+08:00

Creating a Data Connection on the Flink Web UI

Scenario

Different data services can be accessed through data connections. Currently, FlinkServer supports HDFS, Kafka data connections.

Creating a Data Connection

  1. Access the Flink web UI. For details, see Accessing the Flink Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. Click Create Data Connection. On the displayed page, select a data connection type, enter information by referring to Table 1, and click OK.

    Table 1 Parameters for creating a data connection

    Parameter

    Description

    Example Value

    Data Connection Type

    Type of the data connection, which can be HDFS, Kafka.

    -

    Data Connection Name

    Name of the data connection, which can contain a maximum of 100 characters. Only letters, digits, and underscores (_) are allowed.

    -

    Cluster Connection

    Cluster connection name in configuration management.

    This parameter is mandatory for HDFS data connections.

    -

    Kafka broker

    Connection information about Kafka broker instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Kafka data connections.

    192.168.0.1:21005,192.168.0.2:21005

    Authentication Mode

    • SIMPLE: indicates that the connected service is in non-security mode and does not need to be authenticated.
    • KERBEROS: indicates that the connected service is in security mode and the Kerberos protocol for security authentication is used for authentication.

    This parameter is mandatory for Kafka data connections.

    -