Managing LakeFormation Data Sources

Updated on 2025-03-03 GMT+08:00

View PDF

On the GaussDB(DWS) console, you can create a LakeFormation data source on the console to access metadata on LakeFormation.

NOTE:

This feature is for limited commercial use only. It is available for storage-compute decoupled clusters of 9.0.1 and later cluster versions or storage-compute coupledclusters in version 8.2.1.300 and later.
LakeFormation is connected through VPC Endpoint. When you create a LakeFormation data source, if there is no VPC endpoint for your GaussDB(DWS) cluster, it will be automatically created. VPC endpoints incur extra fees.

Prerequisites

A LakeFormation instance is available. For details, see section "Creating a LakeFormation Instance" in LakeFormation Usage Guide.
To connect to the LakeFormation instance, you need to create a VPCEP client. You can create one in either of the following ways:
- Method 1 (recommended): Access the LakeFormation console, click Clients, and create a client. For details, see Managing Clients.
- Method 2: If you cannot access the client created in method 1 while creating a data source, you can create a LakeFormation instance client on VPCEP within the VPC where the GaussDB(DWS) cluster is located. In this case, the IAM user must have the necessary permissions to query and create VPCEP. Note that the VPCEP client created using this method operates separately from LakeFormation. If there are any urgent updates to the LakeFormation instance that require synchronization, it is recommended to use method 1.
Create an agency with LakeFormation permissions (including the minimum permissions). For details about how to configure the permissions, see section "Data Permission Authorization" in LakeFormation Usage Guide. If the permissions are not correctly configured, an error will be reported.
For an IAM user to use GaussDB(DWS) to call APIs on the LakeFormation management plane, the user must have LakeFormation permissions (at least lakeformation:instance:access and lakeformation:instance:describe).

Creating a LakeFormation Data Source

On the GaussDB(DWS) console, choose Dedicated Clusters > Clusters.
In the cluster list, click the name of a cluster. On the page that is displayed, choose Data Sources > LakeFormation Data Sources.

Click Create LakeFormation Data Source Connection and configure parameters.

Figure 1 Creating a LakeFormation data source connection
Click to enlarge

**Table 1** LakeFormation data source connection parameters
Parameter	Description
Data Source	Name of the LakeFormation data source connection to be created
LakeFormation Instance	LakeFormation cluster instance to be bound
Database	Database where the LakeFormation data source connection is to be created
Agency	An agency authorized by LakeFormation. GaussDB(DWS) interacts with LakeFormation through this agency token o obtain metadata.
Description	Description about the LakeFormation data source connection

Confirm the settings and click OK. The creation takes about 1 minute.

Updating a Configuration

Scenario

After a data source connection is created, its VPC endpoint is deleted by mistake and the data source cannot be used.
The agency needs to be changed.
A token fails to be updated. After this issue is fixed, the token needs to be updated immediately.

Procedure

On the GaussDB(DWS) console, choose Dedicated Clusters > Clusters.
In the cluster list, click the name of a cluster. On the page that is displayed, choose Data Sources > LakeFormation Data Sources.
In the Operation column of a LakeFormation data source, click Update Configuration.
During the update, you can only change the agency. After confirming that the agency is correct, click OK to submit the update. The update takes about 1 minute.

Figure 2 Updating a LakeFormation data source connection

Deleting a LakeFormation Data Source

On the GaussDB(DWS) console, choose Dedicated Clusters > Clusters.
In the cluster list, click the name of a cluster. On the page that is displayed, choose Data Sources > LakeFormation Data Sources.
In the Operation column of a LakeFormation data source, click Delete.
Confirm the settings and click OK. The deletion takes about 10 seconds.

Using a LakeFormation Data Source

For details about how to use the LakeFormation data source, see "Data Migration > Data Import > Using LakeFormation to Import Data" in Data Warehouse Service Developer Guide

Parent topic: Data Source Management

Previous topic: Managing OBS Data Sources

Next topic: GaussDB(DWS) Cluster Data Security and Encryption

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot