Updated on 2022-12-12 GMT+08:00

Viewing Data Lineages

If you have configured data lineages and started job scheduling in the DataArts Factory module, you can start a metadata collection task in the DataArts Catalog module to view the data lineages.

Prerequisites

Data lineages have been automatically or manually configured. For details, see Configuring Data Lineages.

Starting Job Scheduling

  1. Log in to the DataArts Studio console. Locate an instance and click Access. On the displayed page, locate a workspace and click DataArts Factory.
  2. In the navigation pane, click and double-click the job for which lineages have been configured to open it.
  3. Click Execute. The system starts parsing lineages of the job.

    If you click Test, the system will not parse lineages of the job.

    Figure 1 Starting job scheduling

Creating a Metadata Collection Task

If a metadata collection task has been created, skip this part.

  1. On the DataArts Studio console, locate an instance and click Access. On the displayed page, locate a workspace and click DataArts Catalog.
  2. Create a metadata collection task by following the instructions in Task Management.

Viewing Data Lineages

  1. On the DataArts Studio console, locate an instance and click Access. On the displayed page, locate a workspace and click DataArts Catalog.
  2. In the navigation pane, choose Data Catalog. In the right pane, click the Technical Assets tab. On this page, you can query jobs, nodes, and tables.

    In the Types area, click All, select Job, Node, and Table, and click OK.

    Jobs do not belong to any data connection. If you select a data connection in the search filters, no result will be returned.

    Figure 2 Selecting types

  3. In the search result, click the name of an asset ending with _job to view its details. On the job details page, click the Job tab and then Edit to go to the job editing page.

    Figure 3 Viewing job details

  4. In the data asset search result, click the name of an asset ending with _node to view its details. On the node details page, you can view the node lineage information.

    • Click the + or - icon beside the node to expand its upstream and downstream links.
    • Click a node to view the its details.
    • Click the Job tab and then Edit to go to the job editing page.
    Figure 4 Viewing lineages of a node

  5. In the data asset search result, click the name of an asset whose icon is a table to view its details. On the table details page, you can view lineages of the table.

    • Click the + or - icon beside the table to expand its upstream and downstream links.
    • Click a table to view the its details.
    Figure 5 Viewing lineages of a table