Updated on 2025-02-22 GMT+08:00

DLI Hudi Metadata

Hudi Metadata Description

When creating a Hudi table, relevant metadata information about the table will be created in the metadata warehouse.

Hudi supports integration with DLI metadata and LakeFormation metadata (integration with LakeFormation metadata is only supported in Spark 3.3.1 or later), using the same integration method as Spark.

  • DLI metadata can be viewed on the Data Management > Databases and Tables page of the DLI management console.
  • LakeFormation metadata can be viewed on the LakeFormation management console.

Related Operations

  • To connect a DLI SQL queue to DLI metadata, follow these steps:
    1. On the SQL Editor page of the DLI management console, click dli in the Catalog list.
    2. In the Databases drop-down list, select the database in the DLI metadata to connect.
  • To connect a DLI general-purpose queue to DLI metadata, follow these steps:

    See Using Spark Jobs to Access DLI Metadata.

  • To connect a DLI SQL queue to LakeFormation metadata, follow these steps:

    See Connecting DLI to LakeFormation.

  • To connect a DLI general-purpose queue to LakeFormation metadata, follow these steps:

    See Connecting DLI to LakeFormation.

  • DLI metadata permissions management

    You can manage the permissions for DLI metadata through DLI SQL permissions management or IAM authentication.

    • DLI SQL permissions management:
      1. Log in to the DLI console. In the navigation pane on the left, choose Data Management > Databases and Tables. On the displayed page, search for the database you want to authorize or click the name of a database and search for the table you want to authorize.
      2. Locate the database or table you want to authorize and click Permissions in the Operation column to view or add permissions.

        See Managing Database Resources on the DLI Console.

    • IAM authentication:

      See "Application Scenarios of IAM Authentication" in Permissions Management.

  • LakeFormation metadata permissions management

    See Connecting DLI to LakeFormation.