Help Center/ Migration Center/ User Guide/ Big Data Lineage/ Collecting Data Lineage/ Creating a Lineage Collection Task
Updated on 2024-11-01 GMT+08:00
View PDF
Share

Creating a Lineage Collection Task

Prerequisites

You have collected metadata.

Procedure

  1. Sign in to the MgC console.
  2. In the navigation pane on the left, choose Research > Big Data Lineage. Select a migration project in the upper left corner of the page.
  3. In the Lineage Collection area, click Create Task.

  4. Select a job type and configure the parameters shown.

    Type

    Parameter

    Configuration

    Lineage template

    File
    Download the lineage template to the local PC and set parameters in the template. The following fields are mandatory:
    • Target Database (TargetDataset)
    • Target Table (TargetTable)
    • Target Connection Name (TargetConnectionName)
    • Target Component Type (TargetComponentType)
    • Upstream Database (SourceDataset)
    • Upstream Table (SourceTable)
    • Upstream Connection Name (SourceConnectionName)
    • Upstream Component Type (SourceComponentType)
    • Job ID (JobId)
    NOTICE:
    • The value of Target Component Type and Upstream Component Type in the template can be Hive SQL or MaxCompute.
    • Cells in the template cannot contain formulas. Otherwise, the parsing will fail.
    Go back to the console and click Select File to upload the saved file to MgC.
    CAUTION:

    The file size cannot exceed 100 MB.

  5. Click Confirm. The data lineage collection task is created. The system automatically starts collecting data lineage.
  6. Click View Tasks. On the displayed page, you can view the collection task in the task list.

  7. Wait until the task status changes to Completed. Then click View Lineage in the upper right corner of the page to view the Lineage Graph.
Parent topic: Collecting Data Lineage