Storage Structure

Hudi generates a Hudi table based on the specified storage path, table name, partition structure, and other attributes when writing data.

In the DLI environment, the data files of the Hudi table are stored in OBS, so they can be inspected by viewing the OBS files.

The following shows the storage structure of a Hudi table with multi-level partitioning using the COW method.

hudi_table
├── .hoodie  // Metadata folder
│   ├── .aux
│   ├── .cleanData
│   ├── .schema
│   ├── .temp
│   ├── hoodie.properties  // Metadata storage file of the Hudi table
│   ├── 20231030232758468.commit.requested  // Write record metadata into the COW table (representing planned)
│   ├── 20231030232758468.inflight  // Write record metadata into the COW table (representing in progress)
│   ├── 20231030232758468.commit  // Write record metadata into the COW table (representing completed)
│   └── ...
├── 2023  // Multi-level partition directory
│   ├── 10
│   │   ├── 30
│   │   │   ├── .hoodie_partition_metadata
│   │   │   ├── 425388c7-1a84-427e-a7b5-18e6745389b5_1-4-0_20231030232758468.parquet
│   │   │   ├── 425388c7-1a84-427e-a7b5-18e6745389b5_1-4-0_20231030524543412.parquet
│   │   │   ├── ...
│   │   │   └── 425388c7-1a84-427e-a7b5-18e6745389b5_1-4-0_20231030744231276.parquet
│   │   └── ...
└── ...