Scaling Model Service Instances in ModelArts Studio (MaaS)

Prerequisites

A model has been deployed in MaaS.

Constraints

The number of instances can only be changed when the model service is in the Running or Alarm state.

Billing

When you add more model service instances, costs for compute, storage, and tokens accumulate as you use the built-in MaaS services. For details, see Model Inference Billing Items.

Scaling Instances

1. Log in to the ModelArts Studio (MaaS) console and select the target region on the top navigation bar.
2. In the navigation pane on the left, choose Real-Time Inference.
3. On the Real-Time Inference page, click the My Services tab. Choose More > Scale in the Operation column of the target service.
4. Perform the following operations as required.
   • Scale-out: Increase the number of instances as required and click OK. In the Scale Service dialog box, click OK.
   • Scale-in: Reduce the number of instances as required and click OK. In the Confirm Scaling dialog box, confirm the information, enter YES, and click OK.
     Figure 1 Confirm Scaling
     

   In the My Services tab, click the service name to access its details page and check whether the change takes effect.

Follow-Up Operations

• Calling a Model Service in ModelArts Studio (MaaS): After a model service is scaled in or out, the model service can be called in other service environments for prediction.
• Viewing the Call Data and Monitoring Metrics of Real-Time Inference on ModelArts Studio (MaaS): MaaS provides call statistics. You can view the call data details of a model service in a specified period and monitor the service usage and resource consumption.