Updated on 2024-10-23 GMT+08:00

HDFS Application Development Process

All stages of the development process are shown and described in Figure 1and Table 1.

Figure 1 HDFS development process
Table 1 Description of HDFS development process

Stage

Description

Reference

Understand the basic concepts.

Before the application development, the basic concepts of HDFS are required to be understood.

HDFS Application Development Overview

Prepare the development and operating environment.

Use IntelliJ IDEA and configure the development environment based on the reference.

The running environment of HDFS is the HDFS client. Install and configure the client based on the reference.

Preparing an HDFS Application Development and Runtime Environment

Prepare projects.

HDFS provides sample projects in various scenarios. Sample projects can be imported for studying.

Importing and Configuring HDFS Sample Projects

Prepare for security authentication.

If a safe cluster is used, the safety certification must be performed.

Preparing the HDFS Authentication Mechanism

Develop projects based on scenarios.

Provide the sample project. This helps users to learn about the programming interfaces of all HDFS components quickly.

Developing an HDFS Application

Compile and run the application.

Users compile the developed application and deliver it for running based on the reference.

Commissioning an HDFS Application

Check the application running results.

Application running results are stored in the directory specified by users. Users can also check the running results through the UI.

Commissioning an HDFS Application