Overview of Importing Data

LakeFormation is a one-stop enterprise-class data lake and warehouse construction service. It provides APIs and a GUI for unified management of data lake metadata, and is compatible with Hive metadata and Ranger permission models. LakeFormation can connect to multiple compute engines (such as MRS and DWS) and big data cloud services seamlessly to ensure quick building and easy operations of data lakes and unleash rich value of service data.

You can use Hive/Spark to store massive amounts of service data in MRS analysis clusters. Hive/Spark data files are stored in OBS. Then, you can use DWS to read data from MRS clusters through LakeFormation.

You can connect a DWS cluster to a LakeFormation instance on the same network. By using LakeFormation, you can access table metadata and permission information. This allows you to read data from OBS files and then write it to DWS.