Importing Data to the Table

Updated on 2022-12-07 GMT+08:00

View PDF

You can import data from OBS to a table created in DLI.

Precautions

Only one path can be specified during data import. The path cannot contain commas (,).
To import data in CSV format to a partitioned table, place the column to be partitioned in the last column of the data source.
You are advised not to concurrently import data in to a table. If you concurrently import data into a table, there is a possibility that conflicts occur, leading to failed data import.
The imported file can be in CSV, Parquet, ORC, JSON, and Avro format. The encoding format must be UTF-8.

Prerequisites

The data to be imported has been stored on OBS.

Procedure

You can import data on either the Data Management page or the SQL Editor page.
- To import data on the Data Management page:
  1. On the left of the management console, choose Data Management > Databases and Tables.
  2. Click the name of the database corresponding to the table where data is to be imported to switch to the table management page.
  3. Locate the row where the target table resides and choose More > Import in the Operation column. The Import dialog box is displayed.
- To import data on the SQL Editor page:
  1. On the left of the management console, click SQL Editor.
  2. In the navigation tree on the left of SQL Editor, click Databases to see all databases. Click the database where the target table belongs. The table list is displayed.
  3. Click on the right of the table and choose Import from the shortcut menu. The Import page is displayed.

In the Import dialog box, set the parameters based on Table 1.

**Table 1** Description
Parameter	Description	Example
Databases	Database where the current table is located.	-
Table Name	Name of the current table.	-
Queues	Queue where the imported data will be used	-
File Format	Format of the data source file to be imported. The CSV, Parquet, ORC, JSON, and Avro formats are supported. Encoding format. Only UTF-8 is supported.	CSV
Path	You can directly enter a path or click and select an OBS path. If no bucket is available, you can directly switch to the OBS management console and create an OBS bucket. When creating an OBS table, you must specify a folder as the directory. If a file is specified, data import may be failed. If a folder and a file have the same name in the OBS directory, the file path is preferred as the path of the data to be imported. NOTE: The path can be a file or folder.	obs://DLI/sampledata.csv
Table Header: No/Yes	This parameter is valid only when File Format is set to CSV. Whether the data source to be imported contains the table header. Click Advanced Settings and select the check box next to Table Header: No. If the check box is selected, the table header is displayed. If the check box is deselected, no table header is displayed.	-
User-defined Delimiter	This parameter is valid only when File Format is set to CSV and you select User-defined Delimiter. The following delimiters are supported: Comma (,) Vertical bar (\|) Tab character (\t) Others: Enter a user-defined delimiter.	Default value: comma (,)
User-defined Quotation Character	This parameter is valid only when File Format is set to CSV and User-defined Quotation Character is selected. The following quotation characters are supported: Single quotation mark (') Double quotation marks (") Others: Enter a user-defined quotation character.	Default value: double quotation marks (")
User-defined Escape Character	This parameter is valid only when File Format is set to CSV and you select User-defined Escape Character. The following escape characters are supported: Backslash (\) Others: Enter a user-defined escape character.	Default value: backslash (\)
Date Format	This parameter is valid only when File Format is set to CSV or JSON. This parameter specifies the format of the date in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd. For definition of characters involved in the date pattern, see Table 3 in the	2000-01-01
Timestamp Format	This parameter is valid only when File Format is set to CSV or JSON. This parameter specifies the format of the timestamp in the table and is valid only Advanced Settings is selected. The default value is yyyy-MM-dd HH:mm:ss. For definition of characters involved in the time pattern, see Table 3 in the	2000-01-01 09:00:00
Error Records Path	This parameter is valid only when File Format is set to CSV or JSON. The parameter specifies the error data is stored in the corresponding OBS path and is valid only Advanced Settings is selected.	obs://DLI/

Click OK.
You can view the imported data in either of the following ways:

NOTE:

Currently, only the first 10 records are displayed.
- Choose Data Management > Databases and Tables in the navigation pane of the console. Locate the row that contains the database where the target table belongs and click More > View Properties in the Operation column. In the displayed dialog box, click the Preview tab to view the imported data.
- In the Databases tab of the SQL Editor, click the database name to go to the table list. Click on the right of a table name and choose View Properties from the shortcut menu. In the displayed dialog box, click Preview to view the imported data.
(Optional) View the status and execution result of the importing job on the Job Management > SQL Jobs page.

Parent topic: Databases and Tables

Previous topic: Modifying the Owners of Databases and Tables

Next topic: Exporting Data from DLI to OBS

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot