Updated on 2024-04-03 GMT+08:00

Data Management Process

The data management function helps you quickly establish data models and provides you with data entities for script and job development. With data management, you can:
  • Manage multiple types of data lakes, such as DWS and MRS Hive.
  • Use the GUI and DDL to manage database tables. If an MRS API connection is used, you cannot view or manage the databases, data tables, and fields of the connection in a visualized manner.
  • Click to view the databases, data tables, and fields in the data connection directory tree. The directory tree is only available for DWS SQL, DLI SQL, and Hive connections using an agent.

If you have created a data connection, a database, and a data table by referring to Preparations, you can skip this section and go to Script Development or Job Development.

The following figure shows the process for using the data management function.
Figure 1 Data management process
  1. Create a data connection to connect to a data lake base service. For details, see Creating a Data Connection.
  2. Create a database based on the service type. For details, see Creating a Database.
  3. If the connection type is DWS, create a database schema and a table. If the connection type is not DWS, create a table. For details, see (Optional) Creating a Database Schema.
  4. Create a table. For details, see Creating a Table.