Help Center/ ModelArts/ ModelArts User Guide (Standard)/ Image Management/ Preset Images Supported by ModelArts/ Preset Dedicated Images in Notebook Instances
Updated on 2024-10-29 GMT+08:00
View PDF
Share

Preset Dedicated Images in Notebook Instances

ModelArts DevEnviron provides Docker container images, which can run as preset containers. Certain preset images are built on common AI engine frameworks such as PyTorch, TensorFlow, and MindSpore. These images are named using the AI engines. Additionally, many common packages are preset in these images, relieving you from the package installation.

The images preset in ModelArts DevEnviron include:

  • Typical preset packages: AI engines based on standard Conda, data analysis software packages such as Pandas and Numpy, and tool software such as CUDA and cuDNN are included to meet your needs.
  • Preset Conda environments: A Conda environment and basic Conda Python (excluding any AI engine) are created for each preset image. The following figure shows the Conda environment for a preset MindSpore image.

    Select a Conda environment based on whether MindSpore is used for debugging.

  • Notebook: a web application that enables you to code on the GUI and combine the code, mathematical equations, and visualized content into a document.
  • JupyterLab plug-ins: enable flavor changing, case sharing to AI Gallery for communication, and instance stopping to improve user experience.
  • Remote SSH: allows you to remotely start and debug a notebook instance from a local PC.
  • Images preset in ModelArts DevEnviron: After these preset images support function development, the custom images created based on these preset images can be directly used for ModelArts training jobs.
Table 1 Preset x86 images

Engine

Image

PyTorch

pytorch1.8-cuda10.2-cudnn7-ubuntu18.04

pytorch1.10-cuda10.2-cudnn7-ubuntu18.04

pytorch1.4-cuda10.1-cudnn7-ubuntu18.04

Tensorflow

tensorflow2.1-cuda10.1-cudnn7-ubuntu18.04

tensorflow1.13-cuda10.0-cudnn7-ubuntu18.04

MindSpore

mindspore1.7.0-cuda10.1-py3.7-ubuntu18.04

mindspore1.7.0-py3.7-ubuntu18.04

mindspore1.2.0-cuda10.1-cudnn7-ubuntu18.04

mindspore1.2.0-openmpi2.1.1-ubuntu18.04

No AI engine (base images dedicated for image customization)

conda3-cuda10.2-cudnn7-ubuntu18.04

conda3-ubuntu18.04

x86-powered PyTorch Base Images

PyTorch contains three types of images:

Image 1: pytorch1.8-cuda10.2-cudnn7-ubuntu18.04

Table 2 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

PyTorch 1.8

Yes

(CUDA 10.2)

swr.{region_id}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20220926104358-041ba2e

Image 2: pytorch1.10-cuda10.2-cudnn7-ubuntu18.04

Table 3 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Pytorch 1.10

Yes

(CUDA 10.2)

swr.{region_id}.myhuaweicloud.com/atelier/pytorch_1_10:pytorch_1.10.2-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221008154718-2b3e39c

Image 3: pytorch1.4-cuda10.1-cudnn7-ubuntu18.04

Table 4 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Pytorch 1.4

Yes

(CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/pytorch_1_4:pytorch_1.4-cuda_10.1-py37-ubuntu_18.04-x86_64-20220926104017-041ba2e

x86-powered TensorFlow Base Images

TensorFlow contains two types of images:

Image 1: tensorflow2.1-cuda10.1-cudnn7-ubuntu18.04

Table 5 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Tensorflow 2.1

Yes

(CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220926144607-041ba2e

Image 2: tensorflow1.13-cuda10.0-cudnn7-ubuntu18.04

Table 6 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Tensorflow 1.13-gpu

Yes

(CUDA 10.0)

swr.{region_id}.myhuaweicloud.com/atelier/tensorflow_1_13:tensorflow_1.13-cuda_10.0-py_3.7-ubuntu_18.04-x86_64-20220926104358-041ba2e

x86-powered MindSpore Base Images

MindSpore contains four types of images:

Image 1: mindspore1.7.0-cuda10.1-py3.7-ubuntu18.04

Table 7 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Mindspore-gpu 1.7.0

Yes

(CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220926104017-041ba2e

Image 2: mindspore1.7.0-py3.7-ubuntu18.04

Table 8 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Mindspore 1.7.0

No

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220926104017-041ba2e

Image 3: mindspore1.2.0-cuda10.1-cudnn7-ubuntu18.04

Table 9 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Mindspore-gpu 1.2.0

Yes

(CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_2_0:mindspore_1.2.0-py_3.7-cuda_10.1-ubuntu_18.04-x86_64-20220926104106-041ba2e

Image 4: mindspore1.2.0-openmpi2.1.1-ubuntu18.04

Table 10 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

Mindspore 1.2.0

No

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_2_0:mindspore_1.2.0-py_3.7-ubuntu_18.04-x86_64-20220926104106-041ba2e

x86-powered Custom Dedicated Base Images

ModelArts provides the following notebook base images powered by custom images (x86): conda3-cuda10.2-cudnn7-ubuntu18.04 and conda3-ubuntu18.04. These images do not have AI engines or related software packages. The image size is only 2 GB to 5 GB. You can use these images as base images and install your desired engine and dependency packages, improving scalability. In addition, these images are preset with some configurations required for starting the development environment. You can use these images after installing required software packages, without the need for any adaptations.

Such images are the most basic ones and have no component installed. They are small enough to facilitate image customization. If you need to use the OBS SDK, use ModelArts SDK instead to copy files. For details, see Transferring Files.

Image 1: conda3-cuda10.2-cudnn7-ubuntu18.04

Table 11 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

None

Yes

(CUDA 10.2)

swr.{region_id}.myhuaweicloud.com/atelier/user_defined_base:cuda_10.2-ubuntu_18.04-x86_64-20221008154718-2b3e39c

Image 2: conda3-ubuntu18.04

Table 12 Information about the image

AI Engine

Whether to Use GPUs

(CUDA Version)

URL

None

No

swr.{region_id}.myhuaweicloud.com/atelier/user_defined_base:ubuntu_18.04-x86_64-20221008154718-2b3e39c

Example:

CN North-Beijing4

swr.cn-north-4.myhuaweicloud.com/atelier/user_defined_base:ubuntu_18.04-x86_64-20221008154718-2b3e39c

CN East-Shanghai1

swr.cn-east-3.myhuaweicloud.com/atelier/user_defined_base:ubuntu_18.04-x86_64-20221008154718-2b3e39c

CN South-Guangzhou

swr.cn-south-1.myhuaweicloud.com/atelier/user_defined_base:ubuntu_18.04-x86_64-20221008154718-2b3e39c