MapReduce Application Development Process
All stages of the development process are shown and described in Figure 1 and Table 1.
| Stage | Description | Reference |
|---|---|---|
| Understand the basic concepts. | Before the application development, the basic concepts of MapReduce are required to be understood. | |
| Prepare the development and operating environment. | Use IntelliJ IDEA and configure the development environment based on the reference. The running environment of MapReduce is the MapReduce client. Install and configure the client based on the reference. | Preparing the MapReduce Application Development and Runtime Environment |
| Prepare projects | MapReduce provides sample projects in various scenarios. Sample projects can be imported for studying. Or you can create a new MapReduce project based on the reference. | |
| Prepare for safety certification. | If a safe cluster is used, the safety certification must be performed. | |
| Develop projects based on scenarios. | Provide the example project. This helps users to learn about the programming interfaces of all Spark components quickly. | |
| Compile and run the application. | Users compile the developed application and deliver it for running based on the reference. | |
| Check the application running results. | Application running results are stored in the directory specified by users. Users can also check the running results through the UI. |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
