Storage Mount Methods
ModelArts supports dynamic storage and extended storage.
- Dynamic storage: Supports dynamic storage mounting while the instance is running without requiring a restart. Storage is automatically remounted upon startup, and data is persisted. This option is suitable for scenarios requiring flexible mounting or temporary storage expansion during runtime.
- Extended storage: Based on a cloud-native persistent storage solution, extended storage provides stable and reliable storage management. However, stopping the instance is required to mount or change storage configurations. This option is suitable for pre-planned, long-term data volumes.
For details about storage types, see Storage Types.
Constraints
- Dynamic storage
- Only notebook instances in dedicated resource pools are supported.
- Dynamic storage operations are only supported while the instance is running.
- Extended storage
- Operations are only supported when the instance fails to start or is stopped.
- A maximum of 30 extended storage configurations can be added.
- If you associate an SFS Turbo file system with an OBS bucket and mount the file system to a notebook instance, there are some restrictions. For details, see Managing SFS Turbo+OBS Storage Interworking.
Adding Dynamic Storage
- Log in to the ModelArts console and perform the following operations as required:
- New console: Choose Model Build > Notebook.
- Old console: Choose Development Space > Notebook.
- On the Notebook page, click the target instance name to go to the instance details page.
- Click the Storage tab. In the Dynamic Storage area, click Add Dynamic Storage.
- Configure the parameters and click OK.
Table 1 Storage type: Object Storage Service – Parallel File System Parameter
Description
Example Value
Storage Address
Enter an address or click the icon to select a storage address.
The storage address must start with obs:// or /, end with /, and must not contain // (except for the prefix).
obs://bucketname/path/
Mount Path
The mount path must be a subdirectory under /data/.
/data/test1/
Blacklisted directories are those with the following prefixes:
/data/, /cache/, /dev/, /etc/, /bin/, /lib/, /sbin/, /modelarts/, /train-worker1-log/, /var/, /resource_info/, /usr/, /sys/, /run/, /tmp/, /infer/, and /opt/
- Check that the storage status is mounted.
If the storage is no longer needed, click Unmount Storage in the Operation column. In the displayed dialog box, click OK.
Unmounting a storage does not affect the data stored in it. If you want to use the storage again in a notebook instance, mount it again.
Adding Extended Storage
- Log in to the ModelArts console and perform the following operations as required:
- New console: Choose Model Build > Notebook.
- Old console: Choose Development Space > Notebook.
- On the Notebook page, click the target instance name to go to the instance details page.
- Click the Storage tab. In the Extended Storage area, click Add Extended Storage.
- Configure the parameters and click OK.
Table 2 Storage type: Object Storage Service – Bucket or Object Storage Service – Parallel File System Parameter
Description
Example Value
Secret
When using DEW secrets to mount storage, you must include 'accessKeyId' and 'secretAccessKey' (corresponding to your AK and SK, respectively). Ensure the information provided is correct, or the function may not work as expected.
AKSK_05
Storage Address
Enter an address or click
to select a storage address.The storage address must start with obs:// or /, end with /, and must not contain // (except for the prefix).
obs://bucketname/path/
Mount Path
The mount path cannot be empty. It cannot be a blacklisted directory and must start and end with a slash (/). It can contain only letters, digits, underscores (_), and hyphens (-).
/temp/
Table 3 Storage type: Scalable File Service Turbo (SFS Turbo) Parameter
Description
Example Value
File System
Select a file system from the drop-down list.
sfs-turbo
File System Directory
The file system directory cannot be empty. It must start and end with a slash (/) and can contain only letters, digits, underscores (_), and hyphens (-).
/demo/
Mount Path
The mount path cannot be empty. It cannot be a blacklisted directory and must start and end with a slash (/). It can contain only letters, digits, underscores (_), and hyphens (-).
/temp/
Blacklisted directories are those with the following prefixes:
/data/, /cache/, /dev/, /etc/, /bin/, /lib/, /sbin/, /modelarts/, /train-worker1-log/, /var/, /resource_info/, /usr/, /sys/, /run/, /tmp/, /infer/, and /opt/
- After the extended storage is added, view the new extended storage in Extended Storage. Figure 1 Expansion Storage
- To modify the extended storage information, click Edit in the Operation column, modify the configuration, and click OK.
- If an extended storage is no longer needed, click Unmount Storage in the Operation column. In the dialog box that appears, click OK.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot