Updated on 2023-09-28 GMT+08:00

Available Inference Base Images

ModelArts inference provides a series of base images. You can create custom images based on these base images to deploy inference services.

x86 (CPU/GPU)

Table 1 TensorFlow

AI Engine Version

Runtime Environment

URI

2.1.0

CPU

GPU (CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817

1.15.5

CPU

GPU (CUDA 11.4)

swr.{region_id}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18

2.6.0

CPU

GPU (CUDA 11.2)

swr.{region_id}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18

Table 2 PyTorch

AI Engine Version

Runtime Environment

URI

1.8.0

CPU

GPU (CUDA 10.2)

swr.{region_id}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221118143845-d65d817

1.8.2

CPU

GPU (CUDA 11.1)

swr.{region_id}.myhuaweicloud.com/aip/pytorch_1_8:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18

Table 3 MindSpore

AI Engine Version

Runtime Environment

URI

1.7.0

CPU

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76

1.7.0

GPU (CUDA 10.1)

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76

1.7.0

GPU (CUDA 11.1)

swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76