ModelArts inference provides a series of base images. You can create custom images based on these base images to deploy inference services.
x86 (CPU/GPU)-powered Base Images
Table 1 TensorFlow
AI Engine Version |
Runtime Environment |
Image |
URI |
2.1.0 |
CPU
GPU(cuda10.1) |
tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817 |
1.15.5 |
CPU
GPU(cuda11.4) |
tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18 |
2.6.0 |
CPU
GPU(cuda11.2) |
tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
Table 2 PyTorch
AI Engine Version |
Runtime Environment |
Image |
URI |
1.8.0 |
CPU
GPU(cuda10.2) |
pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221118143845-d65d817 |
1.8.2 |
CPU
GPU(cuda11.1) |
pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/pytorch_1_8:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
Table 3 MindSpore
AI Engine Version |
Runtime Environment |
Image name |
URI |
1.7.0 |
CPU |
mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
1.7.0 |
GPU(cuda10.1) |
mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
1.7.0 |
GPU(cuda11.1) |
mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
TensorFlow (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by TensorFlow (CPU/GPU):
Engine Version 1: tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817
- Image creation time: 20220713110657 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 10.1.243
- cuDNN: 7.6.5.32
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-2.1/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-2.1/lib/python3.7/site-packages
Engine Version 2: tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18
- Image creation time: 20220524162601 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 20.04.4 LTS
- CUDA: 11.4.3
- cuDNN: 8.2.4.15
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-1.15.5/bin/python, Python 3.8.13
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-1.15.5/lib/python3.8/site-packages
Engine Version 3: tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18
- Image creation time: 20220524162601 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 11.2.0
- cuDNN: 8.1.1.33
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-2.6.0/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-2.6.0/lib/python3.7/site-packages
PyTorch (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by PyTorch (CPU/GPU):
Engine Version 1: pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221118143845-d65d817
- Image creation time: 20220713110657 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 10.2.89
- cuDNN: 7.6.5.32
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/PyTorch-1.8/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/PyTorch-1.8/lib/python3.7/site-packages
Engine Version 2: pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/aip/pytorch_1_8:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18
- Image creation time: 20220524162601 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 11.1.1
- cuDNN: 8.0.5.39
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/PyTorch-1.8.2/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/PyTorch-1.8.2/lib/python3.7/site-packages
MindSpore (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by MindSpore (CPU/GPU):
Engine Version 1: mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76
- Image creation time: 20220702120711 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/MindSpore/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages
Engine Version 2: mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76
- Image creation time: 20220702120711 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 10.1.243
- cuDNN: 7.6.5.32
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/MindSpore/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages
Engine Version 3: mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76
- Image creation time: 20220702120711 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 11.1.1
- cuDNN: 8.0.5.39
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/MindSpore/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages