Updated on 2024-11-19 GMT+08:00

Using Lite Server

ModelArts Lite Server provides various xPU bare metal servers (BMSs), allowing you to install and deploy third-party software such as AI frameworks and applications as user root. To create a BMS, you only need to configure the specifications, image, network, and key pairs.

This document helps you understand how to use Lite Server.

Figure 1 Process for using Lite Server

  1. Purchasing resources
    Purchase resources first.
    1. Contact the customer manager to determine a resource solution. Apply for the required resource specifications since certain specifications are restricted.
    2. The default resources provided by Huawei Cloud, such as elastic cloud server (ECS), elastic IP (EIP), and Scalable File Service (SFS), may not meet your requirements. Submit a service ticket to increase resource quota.
    3. Grant the required basic permissions to the IAM user.
    4. ModelArts needs to access other dependent services. Create an agency for ModelArts.
    5. When purchasing resources, you need to select a virtual private cloud (VPC) for network communication. You can use an existing VPC or create one.
    6. When you use key pairs to log in to the BMS, use an existing key pair or create one.
    7. Purchase resources on the ModelArts console.
  2. Configuring resources

    Configure the network, storage, and software environment.

  3. Using resources

    Log in to the server for model training and inference. For details, see Using Lite Server Resources.

  4. Managing resources

    Lite Server allows you to start, stop, and switch OSs. You can manage resources on the ModelArts console.

Table 1 Terms

Term

Description

BMS

Combining VM scalability with physical server performance, BMS provides dedicated cloud servers. These servers are designed to meet the demands of computing performance and data security for core databases, critical applications, high-performance computing (HPC), and big data.

After you purchase Lite Server on the ModelArts console, a BMS corresponding to it will be created on the BMS console as Lite Server is a BMS. You can mount disks and bind EIPs on the BMS console.

xPU

Graphics processing unit (GPU) or neural network processing unit (NPU).

  • GPUs are used to accelerate the training and inference of deep learning models.
  • NPUs are used to accelerate neural network computing. Compared with GPUs, NPUs feature higher efficiency and lower power consumption at neural network computing.

Key Pair

You can log in to an elastic server using only an SSH key pair. Therefore, you do not need worry about password interception, cracking, and leakage.

NOTE:

To ensure ECS security, private keys that are not managed by Huawei Cloud can be downloaded only once. Keep your downloaded private keys properly.

VPC

A VPC is a logically isolated, configurable, and manageable virtual network. It helps improve the security of cloud resources and simplifies network deployment. Within your own VPC, you can create security groups and VPNs, configure IP address ranges, and specify bandwidth sizes by customizing security groups, VPNs, IP address ranges, and bandwidth. This simplifies network management. You can also customize access rules to control BMS access within a security group and across different security groups to enhance BMS security.