Introduction to Data Importing

Updated on 2024-06-12 GMT+08:00

View PDF

After a dataset is created, you can import more data. ModelArts allows you to import data from different data sources.

ModelArts AI Gallery provides a large number of built-in datasets, including file and table datasets. You can download and use the built-in datasets from AI Gallery. You can also import your data to ModelArts.

File Data Sources

You can import data by downloading built-in datasets from AI Gallery, or from OBS or a local file. After the import, the data from the import path is automatically synchronized to the data source path of the dataset.

OBS: Import data from an OBS path or a manifest file.
Local file: Import local data that has been uploaded to an OBS path.

Table Data Sources

You can import data by downloading built-in datasets from AI Gallery, or from OBS, DWS, DLI, MRS, and local files.

Import Mode

There are five modes for importing data to a dataset.

When you create a dataset, select an import path. The data is automatically synchronized from the import path.
Figure 1 Importing data when creating a dataset
After a dataset is created, click Import in the Operation column on the dataset list page.
Figure 2 Importing data on the dataset list page
On the dataset list page, click a dataset. On the dataset details page, choose Import > Import.
Figure 3 Importing data on the dataset details page
On the dataset list page, click a dataset. On the dataset details page, click Synchronize Data Source to synchronize data from OBS.
Figure 4 Synchronizing data sources on the dataset details page
Add data on the labeling job details page.
Figure 5 Adding data on the labeling job details page