Help Center/
MapReduce Service/
Service Overview/
Components/
Spark2x/
Spark2x Open Source New Features
Updated on 2022-09-14 GMT+08:00
Spark2x Open Source New Features
Purpose
Compared with Spark 1.5, Spark2x has some new open-source features. The specific features or concepts are as follows:
- DataSet: For details, see SparkSQL and DataSet Principle.
- Spark SQL Native DDL/DML: For details, see SparkSQL and DataSet Principle.
- SparkSession: For details, see SparkSession Principle.
- Structured Streaming: For details, see Structured Streaming Principle.
- Optimizing Small Files
- Optimizing the Aggregate Algorithm
- Optimizing Datasource Tables
- Merging CBO
Parent topic: Spark2x
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.
The system is busy. Please try again later.
