Help Center/ ModelArts/ ModelArts User Guide (Lite Cluster)/ Before You Start/ Software Versions Required by Different Models
Updated on 2024-11-11 GMT+08:00

Software Versions Required by Different Models

A resource pool for elastic clusters can use either Elastic Bare Metal Servers (BMSs) or Elastic Cloud Servers (ECSs) as nodes. Each node model has its own operating system (OS) and compatible CCE cluster versions. This document outlines the necessary software versions for each model to simplify image creation and software upgrades.

Software Versions Required by BMSs

Table 1 BMS

Type

Card Type

RDMA Network Protocol

OS

Applicable Scope

Dependent Plug-in

NPU

ascend-snt9b

RoCE

  • OS: EulerOS 2.10 64-bit (recommended)
  • Kernel version: 4.19.90-vhulk2211.3.0.h1543.eulerosv2r10.aarch64
  • Architecture type: aarch64
  • Cluster type: CCE Standard
  • Cluster version: v1.23 (v1.23.5-r0 or later) or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs
  • huawei-npu
  • npu-driver
  • volcano

For details about the plug-in version mapping, see Table 3.

RoCE

  • OS: Huawei Cloud EulerOS 2.0 64-bit
  • Kernel version: 5.10.0-60.18.0.50.r865_35.hce2.aarch64
  • Architecture type: aarch64
  • Cluster type: CCE Turbo
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: ENI
  • Cluster forwarding mode: iptables or ipvs

ascend-snt9

RoCE

  • OS: EulerOS 2.8 64-bit
  • Kernel version: 4.19.36-vhulk1907.1.0.h619.eulerosv2r8.aarch64
  • Architecture type: aarch64
  • Cluster type: CCE Standard or Turbo
  • Cluster version: v1.23 (v1.23.5-r0 or later) and v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network, VPC, or ENI
  • Cluster forwarding mode: iptables or ipvs

GPU

gp-ant8

RoCE

  • OS: EulerOS 2.10 64-bit
  • Kernel version: 4.18.0-147.5.2.15.h1109.eulerosv2r10.x86_64
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC

    Distributed training only supports container tunnel network.

  • Cluster forwarding mode: iptables or ipvs
  • gpu-beta
  • gpu-driver
  • rdma-sriov-dev-plugin

For details about the plug-in version mapping, see Table 3.

gp-ant1

RoCE

  • OS: EulerOS 2.10 64-bit
  • 4.18.0-147.5.2.15.h1109.eulerosv2r10.x86_64
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC

    Distributed training only supports container tunnel network.

  • Cluster forwarding mode: iptables or ipvs

gp-vnt1

RoCE|IB

  • OS: EulerOS 2.9 64-bit (used only for p6 and p6s flavors in Shanghai 1)
  • Kernel version: 147.5.1.6.h1099.eulerosv2r9.x86_64
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC

    Distributed training only supports container tunnel network.

  • Cluster forwarding mode: iptables or ipvs
  • OS: EulerOS 2.9 64-bit (recommended)
  • Kernel version: 4.18.0-147.5.1.6.h841.eulerosv2r9.x86_64
  • Architecture type: x86
  • Remote direct memory access (RDMA) is a direct memory access from the memory of one computer into that of another without involving either one's operating system.
  • RDMA over Converged Ethernet (RoCE) is a network protocol which allows RDMA over an Ethernet network.
  • InfiniBand (IB) is a computer networking communications standard used in high-performance computing. It is used for data interconnect both among and within computers.

Software Versions Required by ECSs

Table 2 ECS

Type

Card Type

OS

Applicable Scope

Dependent Plug-in

NPU

ascend-snt3p-300i

  • OS: EulerOS 2.9
  • Architecture type: x86
  • Cluster type: CCE Standard or Turbo
  • Cluster version: v1.23 (v1.23.5-r0 or later) and v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network, VPC, or ENI
  • Cluster forwarding mode: iptables or ipvs
  • huawei-npu
  • npu-driver
  • volcano

For details about the plug-in version mapping, see Table 3.

ascend-snt3

  • OS: EulerOS 2.5
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs
  • OS: EulerOS 2.8
  • Architecture type: Arm
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC

    Cluster forwarding mode: iptables or ipvs

GPU

gp-vnt1

  • OS: EulerOS 2.9
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs
  • gpu-beta
  • gpu-driver
  • rdma-sriov-dev-plugin

For details about the plug-in version mapping, see Table 3.

gp-ant03

  • OS: EulerOS 2.9
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs

gp-ant1-pcie40

  • OS: EulerOS 2.9
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs

gp-tnt004

  • OS: EulerOS 2.9
  • Architecture type: x86
  • Cluster type: CCE Standard
  • Cluster version: v1.23 or v1.25 (recommended)
  • Cluster scale: 50, 200, 1000, or 2000
  • Cluster network mode: container tunnel network or VPC
  • Cluster forwarding mode: iptables or ipvs

Mapping Between Plug-in Versions and CCE Cluster Versions

Table 3 Mapping between plug-in versions and CCE cluster versions

Type

Plug-in

Plug-in Version

Matched CCE Cluster Version

Applicable Scope

Plug-in Function

ccePlugin

gpu-beta

2.0.48 (recommended)

v1.(23|25).*

GPU

Allows containers to use GPU devices.

1.2.15

v1.23.*

huawei-npu

2.1.5 (recommended)

v1.(23|25).*

NPU

Allows containers to use Huawei NPU devices.

volcano

1.11.9 (recommended)

v1.(23|25).*

NPU

Kubernetes-based batch processing platform.

npuDriver

npu-driver

7.1.0.7.220-23.0.5 (recommended)

7.1.0.5.220-23.0.3

None

NPU

Upgrades and rolls back NPU drivers.

helm

rdma-sriov-dev-plugin

0.1.0

None

Used for BMS and RDMA (non-ascend-1980)

Allows containers to use RDMA NICs.

memarts

3.23.6-r002

None

None

Near-compute distributed cache plug-in, which is used for storage acceleration.

os-node-agent

6.5.0-20240529142433

None

None

OS plug-in, which is used for fault detection.

icAgent

icagent

default

The matched CCE version is installed by default.

None

CCE basic component, which is used for logging and monitoring.

gpuDriver

gpu-driver

515.65.01 (recommended)

510.47.03

470.182.03

470.57.02

gpu-driver is related to the system kernel version. For details, see Table 4.

Upgrades and rolls back GPU drivers. The plug-in depends on the gpu-beta version.

Mapping Between the Kernel and gpu-driver

Table 4 Mapping between the kernel and gpu-driver

Image Tag

Kernel Version

Matched CCE

gpu-driver Version

EulerOS 2.10

4.18.0-147.5.2.15.h1109.eulerosv2r10.x86_64

v1.(23|25|27|28).*

Container tunnel network, VPC, or ENI

470.57.02

4.18.0-147.5.2.5.h805.eulerosv2r10.x86_64

v1.(23|25|27).*

Container tunnel network, VPC, or ENI

470.57.02

EulerOS 2.9

4.18.0-147.5.1.6.h841.eulerosv2r9.x86_64

v1.(23|25|27|28).*

Container tunnel network or VPC

470.57.02

EulerOS 2.3

3.10.0-514.44.5.10.h193.x86_64

v1.(23|25).*

Container tunnel network or VPC

470.57.02

3.10.0-514.44.5.10.h254.x86_64

v1.(23|25).*

Container tunnel network or VPC

470.57.02