Help Center/ MapReduce Service/ Developer Guide (Normal_Earlier Than 3.x)/ Flink Development Guide/ Preparing a Flink Application Development Environment/ Installing the Flink Client
Updated on 2024-08-16 GMT+08:00
View PDF
Share

Installing the Flink Client

Flink uses a Windows environment for development. It is recommended that the running environment be deployed on a Linux OS because the MRS client cannot be installed in a Windows environment. Perform the following operations to configure the client.

Procedure

  1. Install the Flink client.

    1. Ensure that the Flink component has been installed on a server.
    2. Download a Flink client program.
      1. Log in to MRS Manager.
      2. Choose Service > Flink > Download Client, set Client Type to All client files, set Download to to Server, and click OK to download the client to the server.
    3. Run the following commands to decompress the MRS_Flink_Client.tar client installation package:

      tar -xvf /tmp/MRS-client/MRS_Flink_Client.tar

      tar -xvf /tmp/MRS-client/MRS_Flink_ClientConfig.tar

    4. Go to the directory (/tmp/MRS-client/MRS_Flink_ClientConfig) where the client installation package is decompressed, run the ./install.sh#{client_install_home} command to install the client.

      Example: ./install.sh /opt/flinkclient

      If Kerberos authentication is enabled for the cluster and you need to use the client on a node outside the cluster, add the IP address of the node where the client is located to the jobmanager.web.allow-access-address configuration item in the Flink configuration file flink-conf.yaml of the client. If Kerberos authentication is not enabled for the cluster, you do not need to modify this configuration item.

  2. Configure network connections for the client.

    If the host where the client is installed is not a node in the cluster, configure network connections for the client to prevent errors when you run commands on the client.

    1. Confirm that the client can communicate with each host.
    2. Add the mapping between the server host name and IP address to the hosts file on the client.
    3. If the yarn-client mode is used, add the mapping between the client host name and IP address to the hosts file on the ResourceManager node of YARN.

      The file path is /etc/hosts on Linux and C:\Windows\System32\drivers\etc\hosts on Windows.

    4. Verify the consistency of time between the client and the cluster. Ensure that the difference between the client time and the Flink cluster time is less than 5 minutes.
    5. Verify that the configuration items in the Flink client configuration file flink-conf.yaml are correctly configured.