Importing and Configuring Spark Sample Projects

Scenario

Spark provides sample projects for multiple scenarios, including Java and Scala sample projects to help you quickly learn Spark projects.

Methods to import Java and Scala projects are the same. Python sample projects do not need to be imported, and you only need to open the Python file (*.py).

The following example describes how to import Java sample code. Figure 1 shows the operation process.

Figure 1 Procedure of importing a sample project

Procedure

1. Download the sample project to the local computer by referring to Obtaining the MRS Application Development Sample Project.
2. Import the Java sample project to IDEA.
   1. Start the IntelliJ IDEA. On the Quick Start page, select Import Project.
      Alternatively, for the used IDEA tool, add the project directly from the IDEA home page. Choose File > Import project... to import a project.

      Figure 2 Importing the project (on the Quick Start page)
      
   2. Select a path for storing the sample project to be imported and click OK.
      Figure 3 Selecting a file or directory to import
      
   3. Confirm the path and project name, and click Next.
      Figure 4 Importing a project from Maven
      
   4. Select the project to import and click Next.
   5. Confirm the JDK used by the project and click Next.
      Figure 5 Selecting the SDK
      
   6. Confirm the project name and path and click Finish to complete the import.
      Figure 6 Selecting a project to import
      
   7. After the import, the imported project is displayed on the IDEA home page.
      Figure 7 Imported project
      

3. (Optional) If a Scala sample application is imported, configure a language for the project.
   1. On the IDEA home page, choose File > Project Structures... to go to the Project Structure page.
   2. Choose Modules, right-click a project name, and choose Add > Scala.
      Figure 8 Selecting Scala
      
   3. On the setting page, select the compiled dependency JAR file and click Apply.
      Figure 9 Selecting the compiler library
      
   4. Click OK to save the settings.

4. Configure the text file encoding format of IDEA to prevent garbled characters.
   1. On the IDEA home page, choose File > Settings....
      Figure 10 Choosing Settings
      
   2. On the Settings page, choose File Encodings. Select UTF-8 from the IDE Encoding drop-down list on the right. Click Apply.

      

   3. Click OK to complete the encoding settings.