Importing and Configuring Spark Sample Projects

Updated on 2024-08-16 GMT+08:00

View PDF

Scenario

Spark provides sample projects for multiple scenarios, including Java and Scala sample projects to help you quickly learn Spark projects.

Methods to import Java and Scala projects are the same. Python sample projects do not need to be imported, and you only need to open the Python file (*.py).

The following example describes how to import Java sample code. Figure 1 shows the operation process.

Figure 1 Procedure of importing a sample project

Procedure

Download the sample project to the local computer by referring to Obtaining the MRS Application Development Sample Project.
Import the Java sample project to IDEA.
1. Start the IntelliJ IDEA. On the Quick Start page, select Import Project.
  Alternatively, for the used IDEA tool, add the project directly from the IDEA home page. Choose File > Import project... to import a project.
  Figure 2 Importing the project (on the Quick Start page)
2. Select a path for storing the sample project to be imported and click OK.
  Figure 3 Selecting a file or directory to import
3. Confirm the path and project name, and click Next.
  Figure 4 Importing a project from Maven
4. Select the project to import and click Next.
5. Confirm the JDK used by the project and click Next.
  Figure 5 Selecting the SDK
6. Confirm the project name and path and click Finish to complete the import.
  Figure 6 Selecting a project to import
7. After the import, the imported project is displayed on the IDEA home page.
  Figure 7 Imported project
(Optional) If a Scala sample application is imported, configure a language for the project.
1. On the IDEA home page, choose File > Project Structures... to go to the Project Structure page.
2. Choose Modules, right-click a project name, and choose Add > Scala.
  Figure 8 Selecting Scala
3. On the setting page, select the compiled dependency JAR file and click Apply.
  Figure 9 Selecting the compiler library
4. Click OK to save the settings.
Configure the text file encoding format of IDEA to prevent garbled characters.
1. On the IDEA home page, choose File > Settings....
  Figure 10 Choosing Settings
2. On the Settings page, choose File Encodings. Select UTF-8 from the IDE Encoding drop-down list on the right. Click Apply.
3. Click OK to complete the encoding settings.

Parent topic: Preparing a Spark Application Development Environment

Previous topic: Preparing a Spark Application Running Environment

Next topic: (Optional) Creating a Spark Application Development Project

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot