ModelArts的推理平台提供了一系列的基础镜像,用户可以基于这些基础镜像构建自定义镜像,用于部署推理服务。
X86架构(CPU/GPU)的推理基础镜像
表1 TensorFlow
AI引擎版本 |
支持的运行环境 |
镜像名称 |
URI |
2.1.0 |
CPU
GPU(cuda10.1) |
tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817 |
1.15.5 |
CPU
GPU(cuda11.4) |
tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18 |
2.6.0 |
CPU
GPU(cuda11.2) |
tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
表2 PyTorch
AI引擎版本 |
支持的运行环境 |
镜像名称 |
URI |
1.8.0 |
CPU
GPU(cuda10.2) |
pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/atelier/pytorch_1_8:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64-20221118143845-d65d817 |
1.8.2 |
CPU
GPU(cuda11.1) |
pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/aip/pytorch_1_8:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18 |
表3 MindSpore
AI引擎版本 |
支持的运行环境 |
镜像名称 |
URI |
1.7.0 |
CPU |
mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
1.7.0 |
GPU(cuda10.1) |
mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
1.7.0 |
GPU(cuda11.1) |
mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64 |
swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76 |
推理基础镜像详情TensorFlow(CPU/GPU)
ModelArts提供了以下TensorFlow(CPU/GPU)推理基础镜像:
引擎版本一:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- 镜像地址:swr.{region_id}.myhuaweicloud.com/atelier/tensorflow_2_1:tensorflow_2.1.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20221121111529-d65d817
- 镜像构建时间:20220713110657(yyyy-mm-dd-hh-mm-ss)
- 镜像系统版本:Ubuntu 18.04.4 LTS
- cuda:10.1.243
- cudnn:7.6.5.32
- Python解释器路径及版本:/home/ma-user/anaconda3/envs/TensorFlow-2.1/bin/python, python 3.7.10
- 三方包安装路径:/home/ma-user/anaconda3/envs/TensorFlow-2.1/lib/python3.7/site-packages
引擎版本二: tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64
- 镜像地址:swr.{region_id}.myhuaweicloud.com/aip/tensorflow_1_15:tensorflow_1.15.5-cuda_11.4-py_3.8-ubuntu_20.04-x86_64-20220524162601-50d6a18
- 镜像构建时间:20220524162601(yyyy-mm-dd-hh-mm-ss)
- 镜像系统版本:Ubuntu 20.04.4 LTS
- cuda:11.4.3
- cudnn:8.2.4.15
- Python解释器路径及版本:/home/ma-user/anaconda3/envs/TensorFlow-1.15.5/bin/python, python 3.8.13
- 三方包安装路径:/home/ma-user/anaconda3/envs/TensorFlow-1.15.5/lib/python3.8/site-packages
- 部分pip安装包列表:
Cython 0.29.21
psutil 5.9.0
matplotlib 3.5.1
protobuf 3.20.1
tensorflow 1.15.5+nv
Flask 2.0.1
grpcio 1.46.1
gunicorn 20.1.0
Pillow 9.0.1
tensorboard 1.15.0
PyYAML 6.0
pip 22.0.4
lxml 4.7.1
numpy 1.18.5
tensorflow-estimator 1.15.1
...
- 部分apt安装包列表:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
引擎版本三:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64
- 镜像地址:swr.{region_id}.myhuaweicloud.com/aip/tensorflow_2_6:tensorflow_2.6.0-cuda_11.2-py_3.7-ubuntu_18.04-x86_64-20220524162601-50d6a18
- 镜像构建时间:20220524162601(yyyy-mm-dd-hh-mm-ss)
- 镜像系统版本:Ubuntu 18.04.4 LTS
- cuda:11.2.0
- cudnn:8.1.1.33
- Python解释器路径及版本:/home/ma-user/anaconda3/envs/TensorFlow-2.6.0/bin/python, python 3.7.10
- 三方包安装路径:/home/ma-user/anaconda3/envs/TensorFlow-2.6.0/lib/python3.7/site-packages
- 部分pip安装包列表:
Cython 0.29.21
requests 2.27.1
easydict 1.9
tensorboardX 2.0
tensorflow 2.6.0
Flask 2.0.1
grpcio 1.46.1
gunicorn 20.1.0
idna 3.3
tensorflow-estimator 2.9.0
pandas 1.1.5
Pillow 9.0.1
lxml 4.8.0
matplotlib 3.5.1
scikit-learn 0.22.1
psutil 5.8.0
PyYAML 5.1
numpy 1.17.0
opencv-python 4.1.2.30
protobuf 3.20.1
pip 21.2.2
...
- 部分apt安装包列表:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
推理基础镜像详情PyTorch(CPU/GPU)
ModelArts提供了以下PyTorch(CPU/GPU)推理基础镜像:
引擎版本一:pytorch_1.8.0-cuda_10.2-py_3.7-ubuntu_18.04-x86_64
引擎版本二:pytorch_1.8.2-cuda_11.1-py_3.7-ubuntu_18.04-x86_64
推理基础镜像详情MindSpore(CPU/GPU)
ModelArts提供了以下MindSpore(CPU/GPU)推理基础镜像:
引擎版本一:mindspore_1.7.0-cpu-py_3.7-ubuntu_18.04-x86_64
引擎版本二:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64
- 镜像地址:swr.{region_id}.myhuaweicloud.com/atelier/mindspore_1_7_0:mindspore_1.7.0-cuda_10.1-py_3.7-ubuntu_18.04-x86_64-20220702120711-8590b76
- 镜像构建时间:20220702120711(yyyy-mm-dd-hh-mm-ss)
- 镜像系统版本:Ubuntu 18.04.4 LTS
- cuda:10.1.243
- cudnn:7.6.5.32
- Python解释器路径及版本:/home/ma-user/anaconda3/envs/MindSpore/bin/python, python 3.7.10
- 三方包安装路径:/home/ma-user/anaconda3/envs/MindSpore/lib/python3.7/site-packages
- 部分pip安装包列表:
cycler 0.11.0
easydict 1.9
Flask 2.0.1
grpcio 1.47.0
gunicorn 20.1.0
ipykernel 6.7.0
Jinja2 3.0.1
lxml 4.9.0
matplotlib 3.5.1
mindinsight 1.7.0
mindspore 1.7.0
mindvision 0.1.0
moxing-framework 2.1.0.5d9c87c8
numpy 1.17.0
opencv-contrib-python-headless 4.6.0.66
opencv-python-headless 4.6.0.66
pandas 1.1.5
Pillow 9.1.1
pip 22.1.2
protobuf 3.20.1
psutil 5.8.0
PyYAML 5.1
requests 2.27.1
scikit-learn 0.22.1
scipy 1.5.2
setuptools 62.6.0
sklearn 0.0
tensorboardX 2.0
threadpoolctl 3.1.0
tomli 2.0.1
tornado 6.1
tqdm 4.64.0
traitlets 5.3.0
treelib 1.6.1
urllib3 1.26.9
wheel 0.37.1
zipp 3.8.0
...
- 部分apt安装包列表:
apt
ca-certificates
cmake
cuda
curl
ethtool
fdisk
ffmpeg
g++
gcc
git
gpg
graphviz
libsm6
libxext6
libopencv-dev
libxrender-dev
libatlas3-base
libnuma-dev
libcap-dev
libssl-dev
liblz-dev
libbz2-dev
liblzma-dev
libboost-graph-dev
libsndfile1
libcurl4-openssl-dev
libopenblas-base
liblapack3
libopenblas-dev
libprotobuf-dev
libleveldb-dev
libsnappy-dev
libhdf5-serial-dev
liblapacke-dev
libgflags-dev
libgoogle-glog-dev
liblmdb-dev
libatlas-base-dev
librdmacm1
libcap2-bin
libpq-dev
mysql-common
net-tools
nginx
openslide-tools
openssh-client
openssh-server
openssh-sftp-server
openssl
protobuf-compiler
redis-server
redis-tools
rpm
tar
tofrodos
unzip
vim
wget
zip
zlib1g-dev
...
引擎版本三:mindspore_1.7.0-cuda_11.1-py_3.7-ubuntu_18.04-x86_64