Viewing Metadata
You can collect metadata about databases and tables by creating a collection task or manually adding or importing metadata to MgC.
Creating a Collection Task
For details about how to create a collection task, see Creating a Metadata Collection Task or Creating a Data Lake Metadata Collection Task. When a task execution enters a Completed status and the collection results are displayed, you can view the list of databases and tables extracted from collected metadata on the Tables tab.
Manually Adding a Table
- Sign in to the MgC console. In the navigation pane, under Project, select your big data migration project from the drop-down list.
- In the navigation pane, choose Migration Preparations.
- Choose Metadata Management and click the Tables tab.
- On the displayed page, click Add.
- Configure the parameters listed in Table 1.
Table 1 Parameters for adding a table Parameter
Description
Metadata Connection
Select the created metadata connection.
Database Name
User-defined
Table Name
User-defined
Source Table Path (Optional)
This parameter is required if a Delta Lake connection is selected for Metadata Connection.
Enter the table path in the source database.
Target Table Path (Optional)
This parameter is required only if a Delta Lake connection (without metadata) is selected for Metadata Connection.
Enter the table path in the target database.
Partitions (Optional)
User-defined
Table Partitioned (Optional)
Specify whether the table is partitioned.
Business Owner (Optional)
You can specify the owner of the business that the data table belongs to.
Analysis Owner (Optional)
Specify the analysis owner of the table.
External
Set it as required. If the table is external, the consistency verification result of the table is not displayed.
Description (Optional)
Enter a table description.
- Click Confirm. Then you can view the table in the table list.
Importing Tables
- Sign in to the MgC console. In the navigation pane, under Project, select your big data migration project from the drop-down list.
- In the navigation pane, choose Migration Preparations.
- Choose Metadata Management and click the Tables tab.
- On the displayed page, click Import.
- Select the created metadata connection.
- Click Download to download the import template to the local PC. Open the import template and fill in the information of the tables to be added.
- A maximum of 10,000 tables can be imported at a time.
- The tables to be imported must come from the same metadata source.
- If a connection to Delta Lake (with metadata) or Hudi (with metadata) is selected for Metadata Connection, the source_path parameter in the template is required.
- If a connection to Delta Lake (without metadata) or Hudi (with metadata) is selected for Metadata Connection, the source_path and target_path parameters in the template are required.
- Go back to the console and click Add to upload the populated template to MgC.
- Click Confirm. The system starts the import. A task execution record is generated for this import. The execution status represents the import status.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot