Help Center/
MapReduce Service/
User Guide (ME-Abu Dhabi Region)/
Overview/
Components/
Spark2x/
Spark2x Open Source New Features
Updated on 2022-02-22 GMT+08:00
Spark2x Open Source New Features
Purpose
Compared with Spark 1.5, Spark2x has some new open-source features. The specific features or concepts are as follows:
- DataSet: For details, see SparkSQL and DataSet Principle.
- Spark SQL Native DDL/DML: For details, see SparkSQL and DataSet Principle.
- SparkSession: For details, see SparkSession Principle.
- Structured Streaming: For details, see Structured Streaming Principle.
- Optimizing Small Files
- Optimizing the Aggregate Algorithm
- Optimizing Datasource Tables
- Merging CBO
Parent topic: Spark2x
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot
