Updated on 2024-08-10 GMT+08:00

Flink Application Development Process

Development Process of a Flink Application

Figure 1 shows the Flink development process:

Figure 1 Development process of a Flink application
Table 1 Description of the development process

Phase

Description

Reference

Understand the basic concepts.

Before the development process, you are advised to gain a basic understanding of Flink.

Flink Application Development Overview

Prepare the development and operating environment.

Flink applications can be developed using Scala or Java. You are advised to use IntelliJ IDEA tool to configure the development environment as instructed, based on your development language.

The running environment of Flink is the Flink client. Install and configure the client as instructed.

Preparing for Development and Operating Environment

Prepare projects.

Flink provides sample projects for you to import and learn. Alternatively, you can create a Flink project as instructed.

Configuring and Importing a Sample Project

Prepare for security authentication.

The security authentication is mandatory if security clusters are used.

Installing the Client and Preparing for Security Authentication

Develop the project.

Sample projects in Scala and Java are provided to help you quickly understand programming interfaces of Flink components.

Developing a Flink Application

Compile and run the application.

Guidance is provided for you to compile and run a developed application.

Compiling and Commissioning the Flink Application

Check running results.

Application running results are stored in a path specified by you. You can also view application running status through Apache Flink Dashboard.

Viewing the Flink Application Commissioning Result

Tune the application.

Tune the application to meet certain service requirements.

After the tuning is complete, the application needs to be compiled and run again.

"Flink Performance Tuning" in the Component Operation Guide