Help Center/
Migration Center/
User Guide/
Big Data Lineage/
Collecting Data Lineage/
Creating a Lineage Collection Task
Updated on 2024-12-20 GMT+08:00
Creating a Lineage Collection Task
Prerequisites
You have collected metadata.
Procedure
- Sign in to the MgC console.
- In the navigation pane on the left, choose Research > Data Lineage. Select a migration project in the upper left corner of the page.
- In the Lineage Collection area, click Create Task.
- Select a job type and configure the parameters shown.
Type
Parameter
Configuration
Lineage template
File
Download the lineage template to the local PC and set parameters in the template. The following fields are mandatory:- Target Database (TargetDataset)
- Target Table (TargetTable)
- Target Connection Name (TargetConnectionName)
- Target Component Type (TargetComponentType)
- Upstream Database (SourceDataset)
- Upstream Table (SourceTable)
- Upstream Connection Name (SourceConnectionName)
- Upstream Component Type (SourceComponentType)
- Job ID (JobId)
NOTICE:- The value of Target Component Type and Upstream Component Type in the template can be Hive SQL or MaxCompute.
- Cells in the template cannot contain formulas. Otherwise, the parsing will fail.
Go back to the console and click Select File to upload the saved file to MgC.CAUTION:The file size cannot exceed 100 MB.
- Lineage template.
- Click Download Template to download the template to the local PC.
- Complete the lineage template. The following parameters are mandatory:
- Target Database (TargetDataset)
- Target Table (TargetTable)
- Target Connection Name (TargetConnectionName)
- Target Component Type (TargetComponentType)
- Upstream Database (SourceDataset)
- Upstream Table (SourceTable)
- Upstream Connection Name (SourceConnectionName)
- Upstream Component Type (SourceComponentType)
- Job ID (JobId)
- The value of Target Component Type and Upstream Component Type in the template can be Hive SQL or MaxCompute.
- Cells in the template cannot contain formulas. Otherwise, the parsing will fail.
- Go back to the console and click Select File to upload the saved file to MgC.
The file size cannot exceed 100 MB.
- Click Confirm. The data lineage collection task is created. The system automatically starts collecting data lineage.
- Click View Tasks. On the displayed page, you can view the collection task in the task list.
- Wait until the task status changes to Completed. Then click View Lineage in the upper right corner of the page to view the Lineage Graph.
Parent topic: Collecting Data Lineage
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbot