ModelArts Best Practices
This document provides ModelArts samples concerning a variety of scenarios and AI engines to help you quickly understand the process and operations of using ModelArts for AI development.
All practical case studies provided in this document are intended solely for scenarios such as function validation and prototype testing. Given the stringent requirements of production environments for high availability, security compliance, observability, and operations management, do not use the case studies in this document directly in production environments.
LLM Training and Inference
| Sample | Scenario | Description |
|---|---|---|
| Deploying a Model from the vLLM-Ascend Open-Source Community on the ModelArts Inference Platform | Inference deployment | Describes how to deploy models obtained from the vLLM-Ascend open-source community on the ModelArts inference platform. |
Video Generation Model Training and Inference
| Sample | Scenario | Description |
|---|---|---|
| Wan series model inference | Describes the inference process of Wan series models based on ModelArts Lite Server. The PyTorch framework and Ascend NPUs are used for inference. |
ModelArts Development Environment Cases
| Sample | Function | Scenario | Description |
|---|---|---|---|
| Migrating the Conda Environment on a Notebook Instance to an SFS Disk | Environment migration | Development environments | Describes how to migrate the Conda environment of a notebook instance to an SFS disk. |
ModelArts Inference Deployment
| Sample | Scenario | Description |
|---|---|---|
| Accessing a Real-Time Service Through a Dedicated API Gateway, WAF, VPC, and ELB | Inference deployment | Describes how to use Dedicated API Gateway (APIG), Web Application Firewall (WAF), Virtual Private Cloud (VPC), and Elastic Load Balance (ELB) to access ModelArts real-time services over the intranet. |
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot