Updated on 2024-12-13 GMT+08:00

Evolution Introduction

Schema evolution allows users to easily change the current schema of a Hudi table to adapt to the data that is changing over time.

This topic is available for MRS 3.2.0 or later versions only.

Schema Evolution Scenarios

Schema evolution scenarios

  • Columns (including nested columns) can be added, deleted, modified, and moved.
  • Partition columns cannot be evolved.
  • You cannot add, delete, or perform operations on nested columns of the Array type.
Table 1 Engines supported

Component

DDL Operation

Hudi Table Write Operation

Hudi Table Read Operation

Hudi Table Compaction Operation

SparkSQL

Y

Y

Y

Y

Flink

N

Y

Y

Y

HetuEngine

N

N

Y

N

Hive

N

N

Y

N