Updated on 2024-12-13 GMT+08:00

Overview

The Time To Live (TTL) function is available in MRS 3.5.0 and later versions only.

Only partition-level Time To Live (TTL) is supported.

The TTL mechanism controls the lifecycle of data in the Hudi table, which is also called the process of data aging. If the TTL function is disabled, you may encounter the following scenarios:

  • Scenario 1: If you want to delete an aged partition for stream processing, you must stop the stream job and run a DDL command to delete the partition.
  • Scenario 2: Aged partitions cannot be deleted in batches. You can use a TTL rule to age data in each partition in streaming jobs or asynchronous jobs.