Updated on 2025-08-19 GMT+08:00

Viewing Metadata

You can collect metadata about databases and tables by creating a collection task or manually adding or importing metadata to MgC.

Creating a Collection Task

For details about how to create a collection task, see Creating a Metadata Collection Task or Creating a Data Lake Metadata Collection Task. When a task execution enters a Completed status and the collection results are displayed, you can view the list of databases and tables extracted from collected metadata on the Tables tab.

Manually Adding a Table

  1. Sign in to the MgC console. In the navigation pane, under Project, select your big data migration project from the drop-down list.
  2. In the navigation pane, choose Migration Preparations.
  3. Choose Metadata Management and click the Tables tab.
  4. On the displayed page, click Add.
  5. Configure the parameters listed in Table 1.

    Table 1 Parameters for adding a table

    Parameter

    Description

    Metadata Connection

    Select the created metadata connection.

    Database Name

    User-defined

    Table Name

    User-defined

    Source Table Path (Optional)

    This parameter is required if a Delta Lake connection is selected for Metadata Connection.

    Enter the table path in the source database.

    Target Table Path (Optional)

    This parameter is required only if a Delta Lake connection (without metadata) is selected for Metadata Connection.

    Enter the table path in the target database.

    Partitions (Optional)

    User-defined

    Table Partitioned (Optional)

    Specify whether the table is partitioned.

    Business Owner (Optional)

    You can specify the owner of the business that the data table belongs to.

    Analysis Owner (Optional)

    Specify the analysis owner of the table.

    External

    Set it as required. If the table is external, the consistency verification result of the table is not displayed.

    Description (Optional)

    Enter a table description.

  6. Click Confirm. Then you can view the table in the table list.

Importing Tables

  1. Sign in to the MgC console. In the navigation pane, under Project, select your big data migration project from the drop-down list.
  2. In the navigation pane, choose Migration Preparations.
  3. Choose Metadata Management and click the Tables tab.
  4. On the displayed page, click Import.
  5. Select the created metadata connection.
  6. Click Download to download the import template to the local PC. Open the import template and fill in the information of the tables to be added.

    • A maximum of 10,000 tables can be imported at a time.
    • The tables to be imported must come from the same metadata source.
    • If a connection to Delta Lake (with metadata) or Hudi (with metadata) is selected for Metadata Connection, the source_path parameter in the template is required.
    • If a connection to Delta Lake (without metadata) or Hudi (with metadata) is selected for Metadata Connection, the source_path and target_path parameters in the template are required.

  7. Go back to the console and click Add to upload the populated template to MgC.
  8. Click Confirm. The system starts the import. A task execution record is generated for this import. The execution status represents the import status.