Help Center/ ModelArts/ Best Practices/ Model Inference/ E2E O&M Solution of ModelArts Inference Services
Updated on 2025-08-12 GMT+08:00

E2E O&M Solution of ModelArts Inference Services

The end-to-end O&M of ModelArts inference services involves the entire AI process including algorithm development, service O&M, and service running.

Overview

End-to-End O&M Process

  • During algorithm development, store service data in Object Storage Service (OBS), and then label and manage the data using ModelArts data management. After the data is trained, obtain an AI model and create model images using a development environment.
  • During service O&M, use an image to create a model and deploy the model as a real-time service. You can obtain the monitoring data of the ModelArts real-time service on the Cloud Eye management console. Configure alarm rules so that you can be notified of alarms in real time.
  • During service running, access real-time service requests into the service system and then configure service logic and monitoring.
Figure 1 End-to-end O&M process for inference services

During the entire O&M process, service request failures and high resource usage are monitored. When the resource usage threshold is reached, the system will send an alarm notification to you.

Figure 2 Alarming process

Advantages

End-to-end service O&M enables you to easily check service running at both peak and off-peak hours and detect the health status of real-time services in real time.

Constraints

End-to-end service O&M applies only to real-time services because Cloud Eye does not monitor batch or edge inference services.

Procedure

This section uses an occupant safety algorithm in travel as an example to describe how to use ModelArts for process-based service deployment and update, as well as automatic service O&M and monitoring.

Figure 3 Occupant safety algorithm implementation
  1. Use a custom image to build a model that can be used on the ModelArts Standard inference platform based on the locally developed model. For details, see Creating a Custom Image on ECS.
  2. On the ModelArts management console, deploy the created model as a real-time service.
  3. Log in to the Cloud Eye management console, configure ModelArts alarm rules and enable notifications with a topic subscribed to. For details, see Setting Alarm Rules.

    After the configuration, choose Cloud Service Monitoring > ModelArts in the navigation pane on the left to view the requests and resource usage of the real-time service.

    Figure 4 Viewing service monitoring metrics

    When an alarm is triggered based on the monitored data, the object who has subscribed to the target topic will receive a message notification.