Updated on 2024-12-13 GMT+08:00

Overview

Collecting data lineage can capture relationships and dependencies between data elements. MgC can virtualize the collected data lineage into graphs.

The following describes the types of jobs data lineage can be collected from and the collection precautions.

Job Type

Collection Precaution

DataArts Studio jobs

You need to export DataArts Studio jobs to an OBS bucket on Huawei Cloud and assign the read and write permissions for the bucket to MgC.

SQL jobs

You need to export SQL jobs and upload them an OBS bucket on Huawei Cloud and assign the read and write permissions for the bucket to MgC.

Lineage template

You need to download the lineage template and fill it with your data.