Creating a Metadata Collection Task

Updated on 2025-02-05 GMT+08:00

View PDF

Use the created metadata connection to create a collection task that gathers the details about source databases, tables, and fields to MgC.

You can create metadata collection tasks for:

You can also add metadata about tables manually or by importing a file. For details, see Viewing Metadata.

Sign in to the MgC console. In the navigation pane, under Project, select a big data migration project from the drop-down list.
In the navigation pane, choose Survey > Preparations.
Choose Metadata Management and click Create Metadata Collection Task.

Figure 1 Create Metadata Collection Task

Set task parameters based on Table 1.

**Table 1** Parameters for configuring a metadata collection task
Parameter	Configuration
Task Name	The default name is Metadata-Collection-4 random characters (including letters and numbers). You can also specify a name.
Metadata Connection	Select the created metadata connection.
Databases	Enter the names of the databases whose metadata needs to be collected. NOTICE: This parameter is mandatory only if a MaxCompute metadata connection is selected. In other cases, it is optional. If it is left blank, the metadata of all databases is collected.
Concurrent Threads	Set the number of concurrent threads for executing the collection. The default value is 3. The value ranges from 1 to 10. Configuring more concurrent threads means more efficient collection, but more connection and MgC Agent (formerly Edge) resources will be consumed.

Click Confirm. The metadata collection task is created.
Under Tasks, you can review the created metadata collection task and its settings. You can modify the task by choosing More > Modify in the Operation column.

Figure 2 Managing a metadata collection task
Click Execute Task in the Operation column to run the task. Each time the task is executed, a task execution is generated.
Click View Executions in the Operation column. Under Task Executions, you can view the execution records of the task and the status and collection result of each task execution. When a task execution enters a Completed status and the collection results are displayed, you can view the list of databases and tables extracted from collected metadata on the Tables tab.

Figure 3 Managing task executions
Locate a table and click Collect in the Lineage column to create a lineage collection task.

Figure 4 Tables

Parent topic: Collecting Metadata

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.