ModelArts inference provides a series of base images. You can create custom images based on these base images to deploy inference services.
x86 (CPU/GPU)-powered Base Images
Table 1 TensorFlow
|
AI Engine Version |
Runtime Environment |
Image |
URI |
|
2.1.0 |
CPU
GPU(cuda10.1) |
tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817 |
|
1.15.5 |
CPU
GPU(cuda11.4) |
tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18 |
|
2.6.0 |
CPU
GPU(cuda11.2) |
tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
Table 2 PyTorch
|
AI Engine Version |
Runtime Environment |
Image |
URI |
|
1.8.0 |
CPU
GPU(cuda10.2) |
pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221118143845-d65d817 |
|
1.8.2 |
CPU
GPU(cuda11.1) |
pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/aip/pytorch_1_8:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
Table 3 MindSpore
|
AI Engine Version |
Runtime Environment |
Image name |
URI |
|
1.7.0 |
CPU |
mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
|
1.7.0 |
GPU(cuda10.1) |
mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
|
1.7.0 |
GPU(cuda11.1) |
mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
TensorFlow (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by TensorFlow (CPU/GPU):
Engine Version 1: tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817
- Image creation time: 20220713110657 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 10.1.243
- cuDNN: 7.6.5.32
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-2.1/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-2.1/lib/python3.7/site-packages
Engine Version 2: tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18
- Image creation time: 20220524162601 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 20.04.4 LTS
- CUDA: 11.4.3
- cuDNN: 8.2.4.15
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-1.15.5/bin/python, Python 3.8.13
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-1.15.5/lib/python3.8/site-packages
- Certain pip installation packages:
Cython 0.29.21
psutil 5.9.0
matplotlib 3.5.1
protobuf 3.20.1
tensorflow 1.15.5+nv
Flask 2.0.1
grpcio 1.46.1
gunicorn 20.1.0
Pillow 9.0.1
tensorboard 1.15.0
PyYAML 6.0
pip 22.0.4
lxml 4.7.1
numpy 1.18.5
tensorflow-estimator 1.15.1
...
- Certain apt installation packages:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
Engine Version 3: tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18
- Image creation time: 20220524162601 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 11.2.0
- cuDNN: 8.1.1.33
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/TensorFlow-2.6.0/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/TensorFlow-2.6.0/lib/python3.7/site-packages
- Certain pip installation packages:
Cython 0.29.21
requests 2.27.1
easydict 1.9
tensorboardX 2.0
tensorflow 2.6.0
Flask 2.0.1
grpcio 1.46.1
gunicorn 20.1.0
idna 3.3
tensorflow-estimator 2.9.0
pandas 1.1.5
Pillow 9.0.1
lxml 4.8.0
matplotlib 3.5.1
scikit-learn 0.22.1
psutil 5.8.0
PyYAML 5.1
numpy 1.17.0
opencv-python 4.1.2.30
protobuf 3.20.1
pip 21.2.2
...
- Certain apt installation packages:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
PyTorch (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by PyTorch (CPU/GPU):
Engine Version 1: pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64
Engine Version 2: pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64
MindSpore (CPU/GPU)-powered Base Images
ModelArts provides the following inference base images powered by MindSpore (CPU/GPU):
Engine Version 1: mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64
Engine Version 2: mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- Image address: swr.{Region ID}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76
- Image creation time: 20220702120711 (yyyy-mm-dd-hh-mm-ss)
- Image system version: Ubuntu 18.04.4 LTS
- CUDA: 10.1.243
- cuDNN: 7.6.5.32
- Path and version of the Python interpreter: /home/ma-user/anaconda3/envs/MindSpore/bin/python, Python 3.7.10
- Third-party package installation path: /home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages
- Certain pip installation packages:
cycler 0.11.0
easydict 1.9
Flask 2.0.1
grpcio 1.47.0
gunicorn 20.1.0
ipykernel 6.7.0
Jinja2 3.0.1
lxml 4.9.0
matplotlib 3.5.1
mindinsight 1.7.0
mindspore 1.7.0
mindvision 0.1.0
moxing-framework 2.1.0.5d9c87c8
numpy 1.17.0
opencv-contrib-python-headless 4.6.0.66
opencv-python-headless 4.6.0.66
pandas 1.1.5
Pillow 9.1.1
pip 22.1.2
protobuf 3.20.1
psutil 5.8.0
PyYAML 5.1
requests 2.27.1
scikit-learn 0.22.1
scipy 1.5.2
setuptools 62.6.0
sklearn 0.0
tensorboardX 2.0
threadpoolctl 3.1.0
tomli 2.0.1
tornado 6.1
tqdm 4.64.0
traitlets 5.3.0
treelib 1.6.1
urllib3 1.26.9
wheel 0.37.1
zipp 3.8.0
...
- Certain apt installation packages:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
Engine Version 3: mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64
