- What's New
- Function Overview
- Service Overview
- Getting Started
- User Guide
- Best Practices
- Developer Guide
-
API Reference
- Before You Start
- API Overview
- API Calling
-
API
- Console
-
LakeCat
- Function Management
- Catalog Management
- Database Management
- Table Management
- Data Table Statistics
- Zone-based Management
- Partition Statistics
- Authorization Management
- User Group Management
- Metadata Statistics
-
Role Management
- Creating a Role
- Listing Roles on Different Pages by Condition
- Deleting a Role
- Obtaining a Role
- Modifying a Role
- Listing All Role Names
- Querying the Users or User groups Under a Role
- Adding One or More Users or User Groups to a Role
- Removing One or More Users or User Groups from a Role
- Updating the Entities in a Role
- Credential Management
- Configuration Management
- User
- Application Examples
- Permissions and Supported Actions
- Appendix
- Change History
- FAQs
- General Reference
Show all
Function Overview
-
LakeFormation
-
LakeFormation lets you manage data lake metadata with a GUI and APIs. It works with Hive and Ranger metadata and permission models, and connects to various compute engines and cloud services for big data. LakeFormation helps you to easily and efficiently build data lakes and operation services, accelerating the release of service data value.
LakeFormation is a serverless service that uses underlying resources to implement cross-AZ deployment, high reliability, auto scaling, unified metadata management, association between metadata and file directories, and interconnection with multiple compute engines.
Regions: regions displayed on the console.
-
-
Instance Management
-
Before using LakeFormation, create an instance. Then, you can perform operations on the instance, such as managing metadata and setting metadata permissions.
LakeFormation provides basic functions such as instance creation, overview, and deletion, helping you easily manage instances and accelerate the planning and deployment of services carried by the data lake.
Regions: regions displayed on the console.
-
-
Metadata Management
-
- Catalog
A top-level resource in the metadata resources of a LakeFormation instance and multiple catalogs can be created in a LakeFormation instance. Metadata information such as name, description, and location are included in catalogs. Catalogs can be created, modified, and deleted.Location indicates the file directory of the OBS parallel file system mapped to the catalog
- Database
Databases are stored in the data catalogs of a LakeFormation instance and multiple databases can be created under a catalog. Metadata information such as name, description, and location are included in databases. You can create, modify, and delete databases, as well as grant and check databases permissions.
Location indicates the file directory of the OBS parallel file system mapped to the databases.- Table
You can create multiple tables in a database. Metadata such as basic information, format and serialization information, fields, and attributes are included in tables. You can create, modify, and delete tables, as well as grant and check permissions.
- Function
Functions are used to perform specific processing on data in SQL queries, including built-in functions and user-defined functions (UDFs).
- Partition
Partitioning is to split a data table by row to reduce the total amount of data read and write operations in specific SQL operations, and therefore shortening the response time.
Regions: regions displayed on the console.
-
-
Permission Management
-
LakeFormation allows you to authorize, cancel, and view data resources such as catalogs, databases, and tables. It helps you implement convenient and unified data permission management for the data lake.
Regions: regions displayed on the console.
-
-
Data Migration Management
-
LakeFormation supports full or incremental migration of metadata and permissions from external services to the current LakeFormation instance for unified management
Regions: regions displayed on the console.
-
-
Managing Clients
-
On the Clients page, you can quickly create and manage access clients. You can also view information such as access IP address, which is required for connect multiple services to LakeFormation instances.
Regions: regions displayed on the console.
-
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot