Creating a Metadata Collection Task

Prerequisites

You have created a metadata connection.

Procedure

1. Sign in to the MgC console. In the navigation pane, under Project, select a big data migration project from the drop-down list.
2. In the navigation pane, choose Survey > Preparations.
3. Choose Metadata Management and click Create Metadata Collection Task.
   Figure 1 Create Metadata Collection Task
   

4. Set task parameters based on Table 1.

   Table 1 Parameters for configuring a metadata collection task

   Parameter	Configuration
   Task Name	The default name is Metadata-Collection-4 random characters (including letters and numbers). You can also specify a name.
   Metadata Connection	Select the created metadata connection.
   Databases	Enter the names of the databases whose metadata needs to be collected. NOTICE: This parameter is mandatory only if a MaxCompute metadata connection is selected. In other cases, it is optional. If it is left blank, the metadata of all databases is collected.
   Concurrent Threads	Set the number of concurrent threads for executing the collection. The default value is 3. The value ranges from 1 to 10. Configuring more concurrent threads means more efficient collection, but more connection and MgC Agent (formerly Edge) resources will be consumed.

5. Click Confirm. The metadata collection task is created.
6. Under Tasks, you can review the created metadata collection task and its settings. You can modify the task by choosing More > Modify in the Operation column.
   Figure 2 Managing a metadata collection task
   

7. Click Execute Task in the Operation column to run the task. Each time the task is executed, a task execution is generated.
8. Click View Executions in the Operation column. Under Task Executions, you can view the execution records of the task and the status and collection result of each task execution. When a task execution enters a Completed status and the collection results are displayed, you can view the list of databases and tables extracted from collected metadata on the Tables tab.
   Figure 3 Managing task executions
   

9. Locate a table and click Collect in the Lineage column to create a lineage collection task.
   Figure 4 Tables