Help Center/
MapReduce Service/
User Guide (Ankara Region)/
Overview/
Components/
Spark/
Spark Open Source New Features
Updated on 2024-11-29 GMT+08:00
Spark Open Source New Features
Purpose
Compared with Spark 1.5, Spark3x has some new open-source features. The specific features or concepts are as follows:
- DataSet: For details, see SparkSQL and DataSet Principle.
- Spark SQL Native DDL/DML: For details, see SparkSQL and DataSet Principle.
- SparkSession: For details, see SparkSession Principle.
- Structured Streaming: For details, see Structured Streaming Principle.
- Optimizing Small Files
- Optimizing the Aggregate Algorithm
- Optimizing Datasource Tables
- Merging CBO
Parent topic: Spark
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot
