Updated on 2025-11-18 GMT+08:00

Dynamically Mounting an OBS Parallel File System

Overview

A parallel file system is an optimized high-performance file system provided by Object Storage Service (OBS). For details, see About Parallel File System.

Dynamic OBS mounting uses a mounting tool to convert the object storage protocol into the POSIX file protocol. OBS storage is simulated as a local file system and dynamically mounted to a running notebook container in ModelArts. After the mounting, you can perform application operations on the OBS objects in the notebook container.

Application Scenarios

Scenario 1: After you mount the OBS storage in which the target dataset is stored to your notebook instance, you can preview and perform operations in the dataset like operating a local file system.

Scenario 2: When training data in a notebook instance, you can use the dataset mounted to a notebook container.

Restrictions

OBS provides object buckets and parallel file systems for storage. The ModelArts notebook supports only the mounting of an OBS parallel file system to /data/ of a notebook container.

On the international website, dynamic mounting of OBS parallel file systems is supported only in CN-Hong Kong, AP-Bangkok, and AP-Singapore regions.

Procedure

Method 1: Through the ModelArts management console

  1. Log in to the ModelArts management console. In the navigation pane on the left, choose Development Workspace > Notebook.
  2. Select a running notebook instance and click its name. On the notebook instance details page, click the Storage tab. From there, click Mount Storage and configure mounting parameters.
    1. Set a local mounting directory. Enter a folder name in /data/, for example, demo. The system will automatically create the folder in /data/ of the notebook container to mount the OBS file system.
    2. Select the folder for storing the OBS parallel file system and click OK.
      Figure 1 Dynamically mounting an OBS parallel file system
  3. View the mounting result on the notebook instance details page.
    Figure 2 Successful mounting
  4. (Optional) Create a soft link in the terminal. The mounted parallel file system directory is displayed in the file directory on the left of the notebook instance.

    For example, run the command below to link the mount point /data/visualization to the /home/ma-user/work/visualization directory. Replace visualization with the actual mount path.

    ln -s /data/visualization /home/ma-user/work/visualization

    By running this command, a soft link named visualization is created in /home/ma-user/work and is directed to /data/visualization. Click on the left of the notebook instance to view the new soft link.

    Figure 3 Creating a soft link