Updated on 2023-08-31 GMT+08:00

Configuring and Importing Sample Projects

Scenario

MapReduce provides sample projects for multiple scenarios to help you quickly learn MapReduce projects.

The following procedure describes how to import MapReduce sample code. Figure 1 shows the operation process.

Figure 1 Procedure of importing sample projects

Prerequisites

  • Ensure that the difference between the local environment time and the cluster time is less than 5 minutes. If the time difference cannot be determined, contact the system administrator. You can view the time of the cluster in the lower-right corner on FusionInsight Manager.
  • The development environment and MRS cluster configuration files have been prepared. For details, see Preparing the Configuration Files for Connecting to the Cluster.

Procedure

  1. Obtain the sample project from the src directory in the directory where the sample code is decompressed by referring to Obtaining Sample Projects from Huawei Mirrors. You can select a sample based on the actual service scenario. For details about the sample, see MapReduce Sample Project.
  2. Place the obtained authentication file and configuration file in the ../src/mapreduce-example-security/conf directory of the MapReduce sample project.

    If you do not use the multi-component accessing sample project and do not want to affect the compilation of the statistics sample project, ignore the errors about the multi-component accessing sample project. Otherwise, delete the files about the multi-component accessing sample project after importing a sample project.

  3. Import the sample project to the IntelliJ IDEA development environment.

    1. Run IntelliJ IDEA and choose File > Open.
    2. In the Open File or Project dialog box, select the sample project folder mapreduce-example-security and click OK.

  4. Set the IntelliJ IDEA text file coding format to prevent garbled characters.

    1. Choose File > Settings from the main menu of IntelliJ IDEA.
    2. In the navigation tree on the left of the Settings window, choose Editor > File Encodings. In the Global Encoding and Project Encodings areas, set parameters to UTF-8, click Apply, and click OK, as shown in Figure 2.
      Figure 2 Setting the IntelliJ IDEA encoding format

  5. Add the configuration information such as the address of the open-source image repository to the setting.xml configuration file of the local Maven by referring to Configuring Huawei Open-Source Mirrors.

    When using the IntelliJ IDEA development tool, you can choose File > Settings > Build, Execution, Deployment > Build Tools > Maven to view the directory where the settings.xml file is stored. Ensure that the directory is <Local Maven installation directory>\conf\settings.xml.
    Figure 3 Directory for storing the settings.xml file