Dynamically Mounting an OBS Parallel File System

Overview

Parallel File System (Parallel File System) is an optimized high-performance file system provided by Object Storage Service (OBS). For details, see About Parallel File System.

Dynamic OBS mounting uses a mounting tool to convert the object storage protocol into the POSIX file protocol. OBS storage is simulated as a local file system and dynamically mounted to a running notebook container in ModelArts. After the mounting, you can perform application operations on the OBS objects in the notebook container.

Application Scenarios

Scenario 1: After you mount the OBS storage in which the target dataset is stored to your notebook instance, you can preview and perform operations in the dataset like operating a local file system.

Scenario 2: When training data in a notebook instance, you can use the dataset mounted to a notebook container.

Restrictions

OBS provides object buckets and PFS for storage.

The ModelArts notebook of the new version supports only the mounting of an OBS parallel file system to /data/ of a notebook container.

Procedure

Method 1: Through the ModelArts management console

1. Log in to the ModelArts management console. In the left navigation pane, choose DevEnviron > Notebook.
2. Select a running notebook instance and click its name. On the notebook instance details page, click the Storage tab. From there, click Mount Storage and configure mounting parameters.
   1. Set a local mounting directory. Enter a folder name in /data/, for example, demo. The system will automatically create the folder in /data/ of the notebook container to mount the OBS file system.
   2. Select the folder for storing the OBS parallel file system and click OK.
      Figure 1 Dynamically mounting an OBS parallel file system
      
3. View the mounting result on the notebook instance details page.
   Figure 2 Successful mounting