Help Center/ MapReduce Service/ Component Operation Guide (LTS)/ Using Flink/ Preparing for Creating a FlinkServer Job/ Creating a FlinkServer Data Connection
Updated on 2024-10-09 GMT+08:00
View PDF
Share

Creating a FlinkServer Data Connection

You can use data connections to access different data services. Currently, FlinkServer supports HDFS, Redis, and Kafka data connections.

Procedure

  1. Access the Flink web UI. For details, see Accessing the FlinkServer Web UI.
  2. Choose System Management > Data Connection Management. The Data Connection Management page is displayed.
  3. Click Create Data Connection. On the displayed page, select a data connection type, enter information by referring to Table 1, and click OK. After the data connection is created, you can edit, test, or delete the data connection in the Operation column.

    Table 1 Parameters for creating a data connection

    Parameter

    Description

    Example Value

    Data Connection Type

    Type of the data connection, which can be HDFS, Redis, or Kafka.

    If you select the Redis data connection type, prepare a DCS (for Redis) instance in advance. Ensure that Instance Type is Redis Cluster, Password Protected is No, and Region and VPC are the same as those of the cluster where Flink is located.

    -

    Data Connection Name

    Name of the data connection.

    -

    Cluster Connection

    Cluster connection name in configuration management.

    This parameter is mandatory for HDFS data connections.

    -

    Kafka broker

    Connection information about Kafka broker instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Kafka data connections.

    192.168.0.1:21005,192.168.0.2:21005

    Redis Deployment Method

    Redis deployment mode. Currently, only Cluster is supported.

    This parameter is mandatory for Redis data connections.

    Cluster

    Redis Server List

    Connection information about Redis instances. The format is IP address:Port number. Use commas (,) to separate multiple instances.

    This parameter is mandatory for Redis data connections.

    192.168.0.1:6379,192.168.0.2:6379

    Authentication Mode
    • SIMPLE: indicates that the connected service is in non-security mode and does not need to be authenticated. The Kafka data connection created using this method supports only the SIMPLE authentication type.
    • KERBEROS: indicates that the connected service is in security mode and the Kerberos protocol for security authentication is used for authentication.

    -