Updated on 2023-08-31 GMT+08:00

Development Process

Flink application development process

The following figure shows the development process.

Figure 1 Development process
Table 1 Flink application development process

Step

Description

Reference

Understand basic concepts

Before application development, you need to understand basic concepts of Flink.

Basic Concepts

Prepare the development and running environment

Flink applications can be developed in Scala or Java. Use IntelliJ IDEA to configure development environments in different languages according to the guide. The Flink operating environment is a Flink client. Install and configure the client according to the guide.

Preparing the Development Environment

Preparing the Configuration Files for Connecting to the Cluster

Create a project

Flink provides sample projects. You can import a sample project to learn the application. You can also create a Flink project according to the guide.

Configuring and Importing Sample Projects

Creating a Project (Optional)

Prepare for security authentication

If a security cluster is used, the authentication is required.

Preparing for Security Authentication

Use development projects based on scenarios

Scala and Java sample projects are provided to help you quickly understand APIs of Flink components.

Developing an Application

Compile and run the application

You can compile the developed application and deliver it for running based on the reference.

Compiling and Running the Application

View application running results

Application running results are stored in a path specified by you. You can also view the running status on the UI.

Viewing the Debugging Result

Tune the application

Tune the application to meet certain service requirements.

After the application tuning is complete, the application needs to be compiled and run again.

"Flink Performance Tuning" in the Component Operation Guide