Getting Started

Preparations

Before using data management of ModelArts, complete the following preparations:

When using data management, ModelArts needs to access dependent services such as OBS. Therefore, grant permissions on the Global Configuration page. For details, see Configuring Agency Authorization (Recommended).

Creating a Dataset

In this example, an OBS path is used as the input path to create a dataset. Perform the following operations to create an object detection dataset and import the data to the dataset:

1. Log in to the . In the navigation pane, choose Data Management > Datasets.
2. Click Create. On the Create Dataset page, create a dataset based on the data type and data labeling requirements.
   1. Set the basic information, the name and description of the dataset.
      Figure 1 Basic information of a dataset
      
   2. Set labeling scene and type. In this example, choose Images and Object detection.
      Figure 2 Dataset labeling scene and type
      
   3. Select an OBS path as Input Dataset Path, and select another OBS path as Output Dataset Path.
      Figure 3 Input and output dataset path
      
   4. After setting the parameters, click Create in the lower right corner to create a dataset.

Labeling Data

• Manual labeling
  1. On the Unlabeled tab page, click an image. The system automatically directs you to the page for labeling the image.
  2. On the toolbar of the labeling page, select a proper labeling tool. In this example, a rectangle is used for labeling.
     Figure 4 Labeling tools
     
  3. Drag the mouse to select an object, enter a new label name in the displayed text box. If labels already exist, select one from the drop-down list box. Click Add.
  4. Click Back to Data Labeling Preview in the upper left part of the page to view the labeling information. In the dialog box that is displayed, click Yes to save the labeling settings. The selected image is automatically moved to the Labeled tab page. On the Unlabeled and All tab pages, the labeling information is updated along with the labeling process, including the added label names and the number of images for each label.

Publishing Data

ModelArts training management allows you to create training jobs using ModelArts datasets or files in an OBS directory. If a dataset is used as the data source of a training job, specify a dataset and version. Therefore, you must have published a dataset version. For details, see Publishing a Data Version.

Data that is from the same source and labeled in different batches are differentiated by version. This facilitates subsequent model building and development. You can select specified versions.

Exporting Data

ModelArts training management allows you to create training jobs using ModelArts datasets or files in an OBS directory. If you create a training job using an OBS directory, export the prepared data to OBS.

1. Export data to OBS.
   1. On the dataset details page, select or filter the data to be exported, and click Export in the upper right corner.
   2. Set Type to OBS, enter related information, and click OK.

      Storage Path: path where the data to be exported is stored. You are advised not to save data to the input or output path of the current dataset.

      Figure 5 Exporting to OBS
      
   3. After the data is exported, view it in the specified path.
2. View task history.

   After exporting data, you can view the export task details in Export History.

   1. On the dataset details page, click Export History in the upper right corner.
   2. In the View Task History dialog box, view the export task history of the current dataset. You can view the task ID, creation time, export type, export path, total number of exported samples, and export status.
      Figure 6 Export history