Object Detection

Starting Labeling

1. Log in to the ModelArts management console. In the left navigation pane, choose Data Management > Datasets. The Datasets page is displayed.
2. In the dataset list, select the dataset to be labeled based on the labeling type, and click the dataset name to go to the Dashboard tab page of the dataset.

   By default, the Dashboard tab page of the current dataset version is displayed. If you need to label the dataset of another version, click the Versions tab and then click Set to Current Version in the right pane. For details, see Managing Dataset Versions.

3. On the Dashboard page of the dataset, click Label in the upper right corner. The dataset details page is displayed. By default, all data of the dataset is displayed on the dataset details page.

Synchronizing Data Sources

ModelArts automatically synchronizes data and labeling information from Input Dataset Path to the dataset details page.

• For an image classification dataset, the .txt file with the same name in the same directory as the data source is used as the label of the target image.
• For an object detection dataset or image segmentation dataset, the .xml file with the same name in the same directory is used as the label of the target image.

To quickly obtain the latest data in the OBS bucket, on the All or Unlabeled tab page of the dataset details page, click Synchronize Data Source to add data from OBS to the dataset.

Filtering Data

On the Dashboard tab page of the dataset, the summary of the dataset is displayed by default. In the upper right corner of the page, click Label. The dataset details page is displayed, showing all data in the dataset by default. On the All, Unlabeled, or Labeled tab page, you can add filter criteria in the filter criteria area to quickly filter the data you want to view.

The following filter criteria are supported. You can set one or more filter criteria.

• Example Type: Select Hard example or Non-hard example.
• Label: Select All or one or more labels you specified.
• Sample Creation Time: Select Within 1 month, Within 1 day, or Custom to customize a time range.
• File Name or Path: Filter files by file name or file storage path.
• Labeled By: Select the name of the user who performs the labeling operation.

• Sample Attribute: Select the attribute generated by auto grouping. This filter criterion can be used only after auto grouping is enabled.
• Data Attribute: This criterion is not available.

Figure 1 Filter criteria

Labeling Images (Manually)

The dataset details page provides the Labeled and Unlabeled tabs. The All tab page is displayed by default.

1. On the Unlabeled tab page, click an image. The image labeling page is displayed. For details about how to use common buttons on the Labeled tab page, see Table 2.
2. In the tool bar, select a proper labeling shape. The default labeling shape is a rectangle. In this example, the rectangle is used for labeling.
   

   On the left of the page, multiple tools are provided for you to label images. However, you can use only one tool at a time.

   Table 1 Supported bounding box

   Icon	Description
   	Rectangle. Click the edge of the upper left corner of the object to be labeled. A rectangle will be displayed. Drag the rectangle to cover the object and click to label the object.
   	Polygon. In the area where the object to be labeled is located, click to label a point, move the mouse and click multiple points along the edge of the object, and then click the first point again. All the points form a polygon. Therefore, the object to be labeled is in the bounding box.
   	Circle. Click the center point of an object, and move the mouse to draw a circle to cover the object and click to label the object.
   	Straight line. Click to specify the start and end points of an object, and move the mouse to draw a straight line to cover the object and click to label the object.
   	Dotted line. Click to specify the start and end points of an object, and move the mouse to draw a dotted line to cover the object and click to label the object.
   	Point. Click the object in an image to label a point.

3. In the Add Label text box, enter a new label name, select the label color, and click Add. Alternatively, select an existing label from the drop-down list.
   Label all objects in an image. Multiple labels can be added to an image. After labeling an image, click an image that has not been labeled in the image list below to label the new image.

   Figure 2 Adding an object detection label
   
4. Click Back to Data Labeling Preview in the upper left part of the page to view the labeling information. In the dialog box that is displayed, click Yes to save the labeling settings.

   The selected image is automatically moved to the Labeled tab page. On the Unlabeled and All tab pages, the labeling information is updated along with the labeling process, including the added label names and the number of images for each label.

Viewing Labeled Images

On the dataset details page, click the Labeled tab to view the list of the labeled images. You can click an image to view the label information about the image in the All Labels area on the right.

Modifying Labeling Information

After labeling data, you can modify labeled data on the Labeled tab page.

• Modifying based on images

  On the dataset details page, click the Labeled tab, select the images to be modified, and click the images. The labeling page is displayed. Modify the image information in the label information area on the right.

  • Modifying a label: In the Labeling area, click the edit icon, enter the correct label name in the text box, and click the check mark to complete the modification. Alternatively, click a label. In the image labeling area, adjust the position and size of the bounding box. After the adjustment is complete, click another label to save the modification.
  • Deleting a label: In the Labeling area, click the deletion icon to delete a label from the image.

    After deleting the label, click Back to Data Labeling Preview in the upper left corner of the page to exit the labeling page. In the dialog box that is displayed, save the modification. After all labels of an image are deleted, the image is displayed on the Unlabeled tab page.

    Figure 3 Editing an object detection label
    

• Modifying based on labels

  On the dataset details page, click the Labeled tab. The information about all labels is displayed on the right.

  • Modifying a label: Click the editing icon in the Operation column. In the dialog box that is displayed, enter the new label name, select the new label color, and click OK. After the modification, the images that have been added with the label use the new label name.
  • Deleting a label: Click the deletion icon in the Operation column to delete a label.
  Figure 4 All labels for object detection
  

Adding Images

In addition to automatically synchronizing data from Input Dataset Path, you can directly add images on ModelArts for data labeling.

1. On the dataset details page, click the All or Unlabeled tab. Then click Add.
2. On the Add page that is displayed, click Add Image.

   Select one or more images to be uploaded in the local environment. Images in JPG, JPEG, PNG, and BMP formats are supported. The size of a single image cannot exceed 5 MB, and the total size of all images uploaded at a time cannot exceed 8 MB.

   After the images are selected, their thumbnails and sizes are displayed on the Add page.

   Figure 5 Adding images
   
3. On the Add page, click OK.

   The images you have added will be automatically displayed in the image list on the Unlabeled tab page. In addition, the images are automatically saved to the OBS directory specified by Input Dataset Path.

Deleting Images

You can quickly delete the images you want to discard.

On the All, Unlabeled, or Labeled tab page, select the images to be deleted or click Select Images on Current Page to select all images on the page, and click Delete in the upper left corner to delete the images. In the displayed dialog box, select or deselect Delete source files as required. After confirmation, click OK to delete the images.

If a tick is displayed in the upper left corner of an image, the image is selected. If no image is selected on the page, the Delete button is unavailable.

If you select Delete source files, images stored in the OBS directory will be deleted accordingly. This operation may affect other dataset versions or datasets using those files, for example, leading to an error in page display, training, or inference. Deleted data cannot be recovered. Exercise caution when performing this operation.