Help Center/ Migration Center/ User Guide/ Big Data Lineage/ Collecting Metadata/ Viewing Metadata
Updated on 2024-11-30 GMT+08:00
View PDF
Share

Viewing Metadata

You can collect metadata about databases and tables by creating a collection task or manually adding or importing metadata to MgC.

Creating a Collection Task

For details about how to create a collection task, see Creating a Metadata Collection Task. When a task execution enters a Completed status and the collection results are displayed, you can view the list of databases and tables extracted from collected metadata on the Tables tab.

Manually Adding a Table

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Research > Data Lineage. Select a migration project in the upper left corner of the page.
  3. In the Metadata Collection area, click View Tables.
  4. On the displayed page, click Add.
  5. Configure the parameters listed in Table 1.

    Table 1 Parameters for adding a table

    Parameter

    Description

    Metadata Connection

    Select the created metadata connection.

    Database

    Enter a name.

    Table

    Enter a name.

    Source Table Path (Optional)

    It is mandatory only if a Delta Lake connection is selected for Metadata Connection.

    Enter the path for storing the data table in the source database.

    Target Table Path (Optional)

    It is mandatory only if a Delta Lake connection (without metadata) is selected for Metadata Connection.

    Enter the path for storing the data table in the target database.

    Partition Info (Optional)

    User-defined

    Is Partitioned (Optional)

    Specify whether the table is partitioned.

    Business Owner (Optional)

    You can specify the owner of the business that the data table belongs to.

    Analysis Owner (Optional)

    Specify the analysis owner of the table.

    External

    Set it as required. If the table is external, the consistency verification result of the table is not displayed.

    Description (Optional)

    Enter a table description.

  6. Click Confirm. Then you can view the table in the table list.

Importing Tables

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Research > Data Lineage. Select a migration project in the upper left corner of the page.
  3. In the Metadata Collection area, click View Tables.
  4. On the displayed page, click Import.
  5. Select the created metadata connection.
  6. Click Download to download the import template to the local PC. Open the import template and fill in the template with the information of the tables to be added.

    • A maximum of 10,000 tables can be imported at a time.
    • The tables to be imported must come from the same metadata source.
    • If a connection to Delta Lake (with metadata) is selected for Metadata Connection, the source_path parameter in the template is mandatory.
    • If a connection to Delta Lake (without metadata) is selected for Metadata Connection, the source_path and target_path parameters in the template are mandatory.

  7. Go back to the console and click Select File to upload the populated template to MgC.
  8. Click Confirm. The system starts the import. A task execution record is generated for this import. The execution status represents the import status.

Parent topic: Collecting Metadata