Help Center/
MapReduce Service/
Service Overview/
Components/
Spark2x/
Spark2x Enhanced Open Source Features/
Spark2x Open Source New Features
Updated on 2024-08-28 GMT+08:00
Spark2x Open Source New Features
Compared with Spark 1.5, Spark2x has some new open-source features.
The specific features or concepts are as follows:
- DataSet: For details, see SparkSQL and DataSet Principle.
- Spark SQL Native DDL/DML: For details, see SparkSQL and DataSet Principle.
- SparkSession: For details, see SparkSession Principle.
- Structured Streaming: For details, see Structured Streaming Principle.
- Optimizing Small Files
- Optimizing the Aggregate Algorithm
- Optimizing Datasource Tables
- Merging CBO
Parent topic: Spark2x Enhanced Open Source Features
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot
