Updated on 2022-11-18 GMT+08:00

Development Process

Development Process of a Flink Application

Figure 1 shows the Flink development process:

Figure 1 Development process of a Flink application
Table 1 Description of the development process

Phase

Description

Reference

Understand the basic concepts.

Before the development process, you are advised to gain a basic understanding of Flink.

Basic Concepts

Prepare the development and operating environment.

Flink applications can be developed using Scala or Java. You are advised to use IntelliJ IDEA tool to configure the development environment as instructed, based on your development language.

The running environment of Flink is the Flink client. Install and configure the client as instructed.

Preparing for Development and Operating Environment

Prepare projects.

Flink provides sample projects for you to import and learn. Alternatively, you can create a Flink project as instructed.

Configuring and Importing a Sample Project

Creating a Project (Optional)

Prepare for security authentication.

The security authentication is mandatory if security clusters are used.

Preparing for Security Authentication

Develop the project.

Sample projects in Scala and Java are provided to help you quickly understand programming interfaces of Flink components.

Developing an Application

Compile and run the application.

Guidance is provided for you to compile and run a developed application.

Compiling and Running the Application

Check running results.

Application running results are stored in a path specified by you. You can also view application running status through Apache Flink Dashboard.

Viewing the Debugging Result

Tune the application.

Tune the application to meet certain service requirements.

After the tuning is complete, the application needs to be compiled and run again.

"Flink Performance Tuning" in the Component Operation Guide