Updating Service Deployment Configurations
Function
This API is used to dynamically adjust the model service deployment configuration.
Debugging
You can debug this API through automatic authentication in API Explorer or use the SDK sample code generated by API Explorer.
Authorization Information
Each account has all the permissions required to call all APIs, but IAM users must be assigned the required permissions.
- If you are using role/policy-based authorization, see Permissions Policies and Supported Actions for details on the required permissions.
- If you are using identity policy-based authorization, the following identity policy-based permissions are required.
Action
Access Level
Resource Type (*: required)
Condition Key
Alias
Dependencies
modelarts:service:updateDeployment
Read
service *
-
-
-
URI
PUT /v2/{project_id}/services/{service_id}/deployments/{deployment_id}
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| project_id | Yes | String | Definition Project ID. For details, see Obtaining a Project ID and Name. Constraints N/A Range Project ID. Default Value N/A |
| service_id | Yes | String | Definition Service ID, which can be obtained from the response body during service creation or by obtaining services owned by the current user. The service_id field is the service ID. Constraints N/A Range Service ID. Default Value N/A |
| deployment_id | Yes | String | Definition Deployment ID, which you can obtain from the response body when adding the deployment or by obtaining service deployments. The deployment_id field indicates the deployment ID. Constraints N/A Range Deployment ID. Default Value N/A |
Request Parameters
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| X-Auth-Token | Yes | String | Definition User token. It can be obtained by calling the IAM API used to obtain a user token. The value of X-Subject-Token in the response header is the user token. For details about how to obtain the token, see Obtaining a User Token Through Password Authentication. Constraints N/A Range N/A Default Value N/A |
| Content-Type | Yes | String | Definition Message body type or format. Constraints N/A Range Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| id | No | String | Definition Deployment ID. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| name | Yes | String | Definition Deployment name. Constraints This parameter is mandatory. If it is not specified, the original value is not retained. Range N/A Default Value N/A |
| pool_id | No | String | Definition Resource pool ID. Services in a specified resource pool are queried. By default, no resource pool is filtered. You can obtain the value by querying the resource pool list. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| framework | No | String | Definition Frame type. Constraints If this parameter is not specified, the default value is used. Range Default Value COMMON |
| count | No | Integer | Definition Number of service instances in the deployment scenario. Constraints If this parameter is not specified, the default value is used. Range [1, 128] Default Value 1 |
| deploy_type | No | String | Definition Deployment type. Constraints If this parameter is not specified, the original value is retained. Range Default Value N/A |
| system_log_dump_enable | No | Boolean | Definition Specifies whether to enable system log dump. Constraints If this parameter is not specified, the default value is used. Range N/A Default Value false |
| unit_configs | No | Array of UnitConfig objects | Definition Instance unit configuration. Constraints
Range N/A Default Value N/A |
| weight | Yes | Integer | Definition Weight percentage of the traffic allocated to the model. This parameter is mandatory only when the model is deployed as a real-time service. Constraints If this parameter is not specified, the original value is retained. Range [0,100] Default Value N/A |
| secret_type | No | String | Definition Secret type. You can select the secret type (dew or agency) to be used here. Constraints
Range Default Value N/A |
| priority | No | Integer | Definition Service priority. Constraints
Range [1, 3] Default Value N/A |
| high_avail_switch | No | Boolean | Definition Specifies whether to enable HA. Once enabled, pods of different instances are evenly distributed to different nodes. Constraints If this parameter is not specified, the default value is used. Range N/A Default Value true |
| description | No | String | Definition Deployment remarks. Constraints If this parameter is left blank, the deployment description is cleared. Range The value can contain a maximum of 512 characters and cannot contain greater-than signs (>) or less-than signs (<). Default Value This parameter is left blank by default. |
| advanced_config | Yes | AdvancedConfig object | Definition Advanced service deployment settings. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| model | No | GroupModel object | Definition Model configuration shared by all inference units. You can select a model and weight file to use with the image. This configuration takes effect for all inference units. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| mirror_traffic_enable | No | Boolean | Definition Specifies whether to enable image traffic. Constraints If this parameter is left blank, the original value is retained. Range N/A Default Value N/A |
| mirror_traffic_weight | No | Integer | Definition Image traffic weight. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| status | No | String | Definition Deployment status. Constraints If this parameter is not specified, the original value is retained. Range Default Value N/A |
| deployment_task_limit | No | DeploymentTaskLimit object | Definition Deployment task restriction for asynchronous service configuration. Constraints If this parameter is not specified, the original value is retained. Range N/A Default Value N/A |
| schedule_strategy | No | String | Definition Scheduling policy. Constraints N/A Range Default Value HIGH_AVAILABILITY |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| id | No | String | Definition Instance unit ID. Constraints N/A Range N/A Default Value N/A |
| name | No | String | Definition Role name of the instance unit. Constraints The value can contain a maximum of 16 characters and must meet the regular expression ^[a-z0-9]([-a-z0-9]*[a-z0-9])?$. Default Value N/A |
| role | No | String | Definition Instance unit role. Constraints N/A Range Default Value N/A |
| custom_spec | No | CustomResourceSpec object | Definition Custom resource specifications. Constraints N/A Example "custom_spec": { "arch": "x86", "cpu": 0.51, "memory": 1024.0 }, |
| flavor | No | String | Definition Resource specifications. Select specifications based on service requirements. When specification is set to custom, the custom specifications are used. custom_spec specifies deployment specifications. Constraints N/A Range N/A Default Value N/A |
| flavor_display_name | No | String | Definition Display name of a resource specification. Constraints N/A Range N/A Default Value N/A |
| image | Yes | ImageInfo object | Definition Image configuration information, including the image path and image source. Constraints N/A |
| models | No | Array of ModelResource objects | Definition This parameter is discarded. You are advised to use files to configure models. Model configuration. You can select a model and weight file to use with the image. Constraints N/A |
| codes | No | Array of Code objects | Definition This parameter is discarded. You are advised to use files to configure code. Code configuration. You can select the OBS path where the code is stored. Constraints N/A |
| files | No | Array of FileInfo objects | Definition Model and code configuration. You can select the model and weight file to work with the image and the OBS path where the code is stored. Constraints N/A |
| dumps | No | Array of Dump objects | Definition Dump configuration. You can select the OBS bucket where the data is to be dumped. Constraints A maximum of 20 groups can be configured. |
| count | No | Integer | Definition Number of configuration instances. Constraints N/A Range N/A Default Value N/A |
| cmd | No | String | Definition Startup command. Constraints N/A Range N/A Default Value N/A |
| termination_grace | No | TerminationGrace object | Definition Graceful shutdown configuration. Constraints N/A |
| envs | No | Map<String,String> | Definition Environment variable. Constraints The length of a variable key cannot exceed 64 characters. The key can only contain letters, digits, underscores (_), hyphens (-), and periods (.), and cannot start with a digit. The value cannot contain HTML tags, including <^>. |
| readiness_health | No | Health object | Definition Readiness health check. Constraints N/A |
| startup_health | No | Health object | Definition Health checks are enabled. Constraints N/A |
| liveness_health | No | Health object | Definition Liveness health check. Range N/A |
| port | No | Integer | Definition Port. Constraints N/A Range [1, 65535] Default Value N/A |
| recovery | No | String | Definition Auto-rebuild policy. When enabled, the platform will automatically rebuild pods according to the policy if they restart due to deployment configuration changes or hardware failures. If disabled, the platform will not intervene. Constraints N/A Range
Default Value N/A |
| npu_reset_enable | No | Boolean | Definition Specifies whether to enable the recovery policy. Constraints N/A Range Default Value N/A |
| group_count | No | Integer | Definition Number of replicas in a unit. This parameter is invalid when deploy_type is set to SINGLE or workload_type is set to DEPLOYMENT. Constraints N/A Range [1, 100] or left empty. Default Value 1 |
| affinity | No | Affinity object | Definition Node affinity scheduling. Constraints N/A |
| security_config | No | ServiceSecurityConfig object | Definition Container user ID/user group ID. Constraints N/A |
| pool_resource_flavor | No | String | Definition Node pool resource specifications. Constraints The value can contain only letters, digits, periods (.), hyphens (-), and underscores (_). Range The value can contain a maximum of 128 characters. Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| gpu | No | Float | Definition Number of GPUs. Constraints N/A Range The value can be a decimal. It cannot be smaller than 0, with the third decimal place is rounded off. Default Value N/A |
| memory | No | Integer | Definition Memory size, in MB. Constraints N/A Range Only integers are supported. Default Value N/A |
| cpu | No | Float | Definition CPU cores. Constraints N/A Range The value can be a decimal. It cannot be smaller than 0.01, with the third decimal place is rounded off. Default Value N/A |
| ascend | No | Integer | Definition Number of Ascend chips. Constraints N/A Range N/A Default Value N/A |
| arch | No | String | Definition Architecture type. Constraints N/A Range x86/arm64. Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| id | No | String | Definition Image ID. Constraints N/A Range N/A Default Value N/A |
| source | Yes | String | Definition Image type, which indicates the image source. Constraints N/A Range Default Value N/A |
| swr_path | Yes | String | Definition Image path. The address is different when the source value is different. Constraints N/A Range N/A Default Value N/A |
| category | No | String | Definition Flavors supported by the image. Constraints N/A Range Default Value CPU |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| source | Yes | String | Definition Code source type. Constraints N/A Range The value is case-insensitive. Default Value N/A |
| address | No | String | Definition Code source address, which complies with the format of different storage systems. Constraints N/A Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Path mounted to the container. The value must start with a slash (/) and can contain hyphens (-), backslashes (), underscores (), periods (.), letters, and digits. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores () are allowed. Default Value N/A |
| host_cache | No | Boolean | Definition Specifies whether the model can be cached locally. This function is disabled by default. Constraints N/A Range Default Value false |
| efs_sub_path | No | String | Definition When the storage type is EFS, subdirectories can be configured. Constraints N/A Range N/A Default Value N/A |
| read_only | No | Boolean | Definition Specifies whether the mount permission is read-only. Constraints N/A Range Default Value N/A |
| os_warm_up | No | Boolean | Definition OS warmup. Constraints N/A Range Default Value N/A |
| source_name | No | String | Definition Warmup name. Constraints This parameter is mandatory when os_warm_up is set to true. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| asset_id | No | String | Definition Preset asset ID. Constraints This parameter is mandatory when preset assets are used. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| source | Yes | String | Definition Code source type. Constraints N/A Range Default Value N/A |
| address | No | String | Definition Code source address, which complies with the format of different storage systems. Constraints N/A Range N/A Default Value N/A |
| source_id | No | String | Definition Code source ID. Either this parameter or address must be specified. The SFS Turbo ID can be input only when source is set to EFS. Constraints N/A Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Path mounted to the container. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| efs_sub_path | No | String | Definition EFS subpath. Constraints N/A Range N/A Default Value N/A |
| read_only | No | Boolean | Definition Specifies whether the mount permission is read-only. Constraints N/A Range Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| source | Yes | String | Definition Code source type. Constraints N/A Range The value is case-insensitive. Default Value N/A |
| address | No | String | Definition Code source address, which complies with the format of different storage systems. Constraints N/A Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Path mounted to the container. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| host_cache | No | Boolean | Definition Specifies whether the model can be cached locally. This function is disabled by default. Constraints N/A Range Default Value false |
| efs_sub_path | No | String | Definition When the storage type is EFS, subdirectories can be configured. Constraints N/A Range N/A Default Value N/A |
| read_only | No | Boolean | Definition Specifies whether the mount permission is read-only. Constraints N/A Range Default Value N/A |
| os_warm_up | No | Boolean | Definition OS warmup. Constraints N/A Range Default Value N/A |
| source_name | No | String | Definition Warmup name. Constraints This parameter is mandatory when os_warm_up is set to true. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| source | Yes | String | Definition Source type of the dump mount directory. Constraints N/A Range Default Value N/A |
| address | No | String | Definition Source address of the dump mount directory. The value can be an HTTPS or OBS address. Constraints N/A Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Path mounted to the container. The value must start with a slash (/) and can contain hyphens (-), backslashes (), underscores (_), periods (.), letters, and digits. Constraints N/A Range N/A Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| check_method | No | String | Definition Health check method, which can be HTTP or EXEC (commands). Constraints N/A Range Default Value During creation, if check_method is not specified, the default value is check_method. During update, if check_method is not specified, an error will be reported. |
| cmd | No | String | Definition Command line mandatory when the health check method is EXEC. Constraints The value can contain 0 to 1,024 characters and cannot contain the following characters: #~^$|%&*<>()'"[]{} Range N/A Default Value N/A |
| url | No | String | Definition Request address mandatory when the health check mode is HTTP. Constraints The value can contain 0 to 1,024 characters. The first character must be a slash (/), and the subsequent characters can be letters, digits, hyphens (-), underscores (_), slashes (/), and colons (:). Range N/A Default Value N/A |
| protocol | No | String | Definition Connection protocol. The default value is HTTP. Constraints N/A Range Default Value N/A |
| initial_delay_seconds | Yes | Integer | Definition Waiting time before the first detection. The default value is 30 and the minimum value is 1. Constraints N/A Range N/A Default Value 30 |
| timeout_seconds | Yes | Integer | Definition Timeout interval of the detection. The default value is 30 seconds, and the minimum value is 1 second. Constraints N/A Range The minimum value is 1 second. Default Value 30s |
| period_seconds | Yes | Integer | Definition Interval at which the health check is performed. The default value is 10 seconds, and the minimum value is 1 second. Constraints N/A Range The minimum value is 1 second. Default Value 10s |
| failure_threshold | Yes | Integer | Definition The minimum number of consecutive detection failures required after a successful detection. Detection is considered failed only when this threshold is reached. The default value is 3. The minimum value is 1. Constraints N/A Range The minimum value is 1. Default Value 3 |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| affinity_type | Yes | String | Definition Node affinity type. Constraints N/A Range Default Value N/A |
| required | Yes | Boolean | Definition Specifies whether to set strong affinity. Constraints N/A Range Default Value N/A |
| selection_mode | Yes | String | Definition Node selection mode. Constraints N/A Range IP Default Value N/A |
| targets | Yes | Map<String,String> | Definition List selected using the preceding method, whose length cannot exceed 20. Constraints N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| user_id | No | Long | Definition user_id set during service container startup. This parameter can be left empty by default. Range [1, 60000] |
| group_id | No | Long | Definition group_id set during service container startup. This parameter can be left empty by default. Range [1, 60000] |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| deploy_timeout_minutes | No | String | Definition Deployment timeout. |
| upgrade_config | Yes | UpgradeConfig object | Definition Rolling upgrade configuration. |
| service_secret | No | ServiceSecret object | Definition Service secret. |
| dynamic_routing_enable | No | Boolean | Definition Intelligent routing switch. |
| strategy | No | String | Definition Intelligent routing policy. |
| ems_enable | No | Boolean | Definition EMS acceleration switch. |
| metric_api_scheme | No | String | Definition Intelligent routing metric collection scheme. |
| metric_api_port | No | String | Definition Intelligent routing metric collection port. |
| metric_api_path | No | String | Definition Intelligent routing metric collection URL. |
| custom_metrics_path | No | String | Definition Custom metric collection URL. |
| port | Yes | Integer | Definition Container port. |
| protocol | Yes | String | Definition Container request protocol. When WSS or WS is selected, the service API is upgraded to WebSocket. WebSocket cannot be enabled together with Traffic Limit. Range |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| type | No | String | Definition Upgrade type. Constraints N/A Range Default Value N/A |
| rolling_update | No | RollingUpdate object | Definition Rolling update configuration. Constraints N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| max_surge | No | String | Definition Maximum number of pods that can be started during rolling update. Constraints A percentage-type string. Range 1/ %to 100% Default Value 1%. |
| max_unavailable | No | String | Definition Maximum number of pods that can be deleted during rolling update. Constraints A percentage-type string. Range 1/ %to 100% Default Value 1%. |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| secret_enable | No | Boolean | Definition Specifies whether to enable the key. Constraints N/A Range Default Value false |
| secret_type | No | String | Definition Secret type. Constraints N/A Range Default Value N/A |
| secret_volumes | No | Array of SecretVolume objects | Definition Secret volume mounting. Constraints Maximum: 30 |
| group_enable | No | Boolean | Definition Specifies whether to enable the image user group. Constraints N/A Range Default Value false |
| group_id | No | Long | Definition User group ID of the image. Constraints N/A Range 1000 to 4294967294 Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| secret_name | No | String | Definition Secret name. Constraints N/A Range N/A Default Value N/A |
| secret_key | No | String | Definition Secret key. Constraints A string of 1 to 63 characters is matched. Only letters, digits, dots (.), underscores (_), and hyphens (-) are allowed. The string cannot start with two consecutive dots (..). Range N/A Default Value N/A |
| secret_value | No | String | Definition Secret value. Constraints The value is a Base64-encoded secret value and contains 1 to 32,768 characters. Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Mount path. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Mandatory | Type | Description |
|---|---|---|---|
| source | Yes | String | Definition Code source type. Constraints N/A Range The value is case-insensitive. Default Value N/A |
| address | No | String | Definition Code source address, which complies with the format of different storage systems. Constraints N/A Range N/A Default Value N/A |
| mount_path | Yes | String | Definition Path mounted to the container. The value must start with a slash (/) and can contain hyphens (-), backslashes (), underscores (_), periods (.), letters, and digits. Constraints N/A Range N/A Default Value N/A |
| host_cache | No | Boolean | Definition Specifies whether the model can be cached locally. This function is disabled by default. Constraints N/A Range Default Value false |
| efs_sub_path | No | String | Definition When the storage type is EFS, subdirectories can be configured. Constraints N/A Range N/A Default Value N/A |
| read_only | No | Boolean | Definition Specifies whether the mount permission is read-only. Constraints N/A Range Default Value N/A |
| os_warm_up | No | Boolean | Definition OS warmup. Constraints N/A Range Default Value N/A |
| source_name | No | String | Definition Warmup name. Constraints This parameter is mandatory when os_warm_up is set to true. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| asset_id | No | String | Definition Preset asset ID. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. |
Response Parameters
Status code: 200
| Parameter | Type | Description |
|---|---|---|
| id | String | Definition Service ID, which can be obtained from the response body during service creation or by obtaining services owned by the current user. The service_id field is the service ID. Range N/A |
| name | String | Definition Service name, which is customized when you create a service. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. |
| workspace_id | String | Definition Workspace ID. Range
|
| type | String | Definition Inference service type. Range |
| deploy_type | String | Definition Deployment mode. Range |
| status | String | Definition Service status. Range |
| failure_reason | String | Definition Reason why the real-time service fails. Range N/A |
| version | ServiceVersionResponse object | Definition Current service version. |
| predict_url | Array of PredictUrlResponse objects | Definition Access address of the real-time service. No value is returned by the service creation API. The value is returned by the details API. |
| dispatcher_group_id | String | Definition ID of the dispatcher group associated with the service. No value is returned by the service creation API. The value is returned by the details API. Range N/A |
| tags | Array of TagsResponse objects | Definition TMS tags. |
| deploy_timeout_minutes | Integer | Definition Deployment timeout. |
| schedule | Array of ScheduleConfigResponse objects | Definition Scheduled stop configuration. |
| create_at | String | Definition Creation time, which is automatically generated. Range Millisecond-level timestamp, which is a 13-digit number, for example, 1609459200000. |
| update_at | String | Definition Update time, which is automatically generated. Range Millisecond-level timestamp, which is a 13-digit number, for example, 1609459200000. |
| task_type | String | Definition Model type. Range |
| provider | String | Definition Account ID of the service provider, which can be obtained by parsing the IAM token from the X-Auth-Token-Provider request header during service creation. If this parameter is not left blank, you need to add X-Auth-Token-Provider to the request header for all update operations on the service. In this case, the value is domain-level or project-level token of the account ID. |
| frozen_infos | Array of FrozenInfo objects | Definition Freezing type returned when a service or deployment is frozen. |
| Parameter | Type | Description |
|---|---|---|
| id | String | Definition Version ID. Range N/A |
| version | String | Definition Version number. Range N/A |
| description | String | Definition Description. Range N/A |
| predict_url | String | Definition Inference request URL. Range N/A |
| runtime_config | RuntimeConfigResponse object | Definition Service runtime settings. |
| upgrade_config | UpgradeConfigResponse object | Definition Service upgrade settings. |
| instance_groups | Array of GroupConfigResponse objects | Definition Service deployment information. |
| lts_strategy | String | Definition Log policy. Range |
| lts_status | String | Definition Status of the interconnection between the deployment and LTS. Range |
| lts_event_status | String | Definition Status of the interconnection between the deployment and LTS Kubernetes events. Range |
| log_configs | Array of LogConfigResponse objects | Definition Service log configuration information. |
| deploy_timeout_minutes | Integer | Definition Deployment timeout. Range N/A |
| Parameter | Type | Description |
|---|---|---|
| service_invoke | ServiceInvokeResponse object | Definition Service call configuration. |
| service_limit | ServiceLimitResponse object | Definition Service constraints. Constraints N/A |
| service_secret | ServiceSecretResponse object | Definition Service secret volume mounting. |
| server_task_limit | ServerTaskLimit object | Definition Service task restriction information. |
| Parameter | Type | Description |
|---|---|---|
| port | Integer | Definition Service port number. Range [1, 65535] |
| protocol | String | Definition Service request protocol. When WSS or WS is selected, the service API is upgraded to WebSocket. WebSocket cannot be enabled together with Traffic Limit. Range |
| auth_type | String | Definition Authentication type. Range |
| internet_access_enable | Boolean | Definition External network access. Range |
| intranet_approval_enable | Boolean | Definition Private network approval. Range |
| dynamic_routing_enable | Boolean | Definition Dynamic route switch. Range |
| strategy | String | Definition Intelligent routing policy. Range |
| metric_api_scheme | String | Definition Protocol of metric API service requests. Range |
| metric_api_port | String | Definition Metric API port number. Range [1, 65535] |
| metric_api_path | String | Definition Metric API path. Range N/A |
| ems_enable | Boolean | Definition Specifies whether to enable EMS acceleration. Range |
| request_retry_enable | Boolean | Definition Specifies whether the proxy supports request rescheduling. Range |
| request_retry_cnt_max | Integer | Definition Maximum number of retries supported by the proxy for request rescheduling. Range [1, 10] |
| request_retry_interval_ms | Integer | Definition Retry interval supported by the proxy for request rescheduling, in milliseconds. Range [1, 10000] |
| fuse_configs | FuseConfig object | Definition Circuit breaker configuration. Range N/A |
| Parameter | Type | Description |
|---|---|---|
| error_rate_fuse_enable | Boolean | Definition Error-rate circuit breaker switch. Constraints N/A Range true: Enable error-rate circuit breaker. false: Disable error-rate circuit breaker. Default Value false: Disable error-rate circuit breaker. |
| error_rate_threshold | Float | Definition Error-rate circuit breaker threshold. Constraints N/A Range (0, 1] (The value can contain a maximum of two decimal places. The third decimal place is rounded off.) Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| rate_limit | RateLimitResponse object | Definition Metrics related to traffic control. |
| request_size_limit | Integer | Definition Request size limit. Range 1–50M |
| request_timeout | Integer | Definition Timeout interval. Range 1 to 1,800 seconds. |
| ip_white_list | Array of strings | Definition IP address whitelist. |
| ip_black_list | Array of strings | Definition IP address blacklist. |
| Parameter | Type | Description |
|---|---|---|
| num | Integer | Definition Maximum number of times a service can be accessed within a unit. Range 1 to 500 |
| unit | String | Definition Traffic limiting unit. Range |
| Parameter | Type | Description |
|---|---|---|
| secret_enable | Boolean | Definition Specifies whether to enable the key. Range |
| secret_type | String | Definition Secret type. Range |
| secret_volumes | Array of SecretVolumeResponse objects | Definition Secret volume mounting. Constraints Maximum: 30 |
| group_enable | Boolean | Definition Specifies whether to enable the image user group. Range |
| group_id | Long | Definition User group ID of the image. Range 1000 to 4294967294 |
| Parameter | Type | Description |
|---|---|---|
| secret_name | String | Definition Secret name. Range N/A |
| secret_key | String | Definition Secret key. Range The value contains up to 63 characters. |
| secret_value | String | Definition Secret value. Range The value contains up to 32,768 characters. |
| mount_path | String | Definition Mount path. Range N/A |
| Parameter | Type | Description |
|---|---|---|
| max_task | Integer | Definition Maximum number of total tasks for a single service. Range [0, 10000] |
| Parameter | Type | Description |
|---|---|---|
| type | String | Definition Upgrade type. Range |
| rolling_update | RollingUpdateResponse object | Definition Rolling update configuration. |
| Parameter | Type | Description |
|---|---|---|
| max_surge | String | Definition Maximum number of pods that can be started during rolling update. Range N/A |
| max_unavailable | String | Definition Maximum number of pods that can be deleted during rolling update. Range N/A |
| Parameter | Type | Description |
|---|---|---|
| id | String | Definition Deployment ID. Range N/A |
| name | String | Definition Deployment name. Range N/A |
| pool_id | String | Definition Resource pool ID. Services in a specified resource pool are queried. By default, no resource pool is filtered. You can obtain the value by querying the resource pool list. Range N/A |
| count | Integer | Definition Number of service instances in the deployment scenario. Constraints N/A Range [1, 128] Default Value N/A |
| system_log_dump_enable | Boolean | Definition Specifies whether to enable system log dump. Constraints This parameter is available only for NPU resource pools. Range N/A Default Value false |
| unit_configs | Array of UnitConfigResponse objects | Definition Inference unit configuration. |
| weight | Integer | Definition Weight percentage of the traffic allocated to the model. This parameter is mandatory only when the model is deployed as a real-time service. Range [0,100] |
| traffic_ratio | String | Definition Traffic ratio, that is, the ratio of the expected user traffic to the total traffic of a single deployment instance. The value is calculated based on the traffic weight configuration and deployment status. Range 0.00/ %to 100.00% |
| secret_type | String | Definition Secret type. You can select the secret type (dew or agency) to be used here. Constraints N/A Range Default Value N/A |
| secret_name | String | Definition Secret name. When using a DEW secret, you can select the secret to be used here. Constraints N/A |
| priority | Integer | Definition Service priority. Constraints N/A Range [1, 3] Default Value N/A |
| high_avail_switch | Boolean | Definition Specifies whether to enable HA. Once enabled, pods of different instances are evenly distributed to different nodes. (This parameter is about to be brought offline. Use the schedule_strategy field instead.) Range |
| framework | String | Definition Algorithm framework. Range |
| version | String | Definition Service version, which consists of digits and periods (.), for example, 1.0.1. Constraints N/A Range The value ranges from 1.0.0 to 99.99.99 and can contain at most eight characters. Default Value N/A |
| version_id | String | Definition Version ID, which can be obtained by querying the version list. Constraints N/A Range N/A Default Value N/A |
| status | String | Definition Service status. Range |
| running_count | Integer | Definition Number of service running instances in the deployment scenario. Constraints N/A Range [1, 128] Default Value N/A |
| deploy_type | String | Definition Deployment type. Range |
| mirror_traffic_enable | Boolean | Definition Specifies whether to enable image traffic. Range N/A |
| mirror_traffic_weight | String | Definition Image traffic weight. Range 50 |
| version_count | Integer | Definition Number of service versions. Range N/A |
| workload_type | String | Definition Workload type. Range N/A |
| update_at | Long | Definition Update time, which is automatically generated. Range Millisecond-level timestamp, which is a 13-digit number. |
| lts_state | String | Definition Status of the interconnection between the deployment and LTS. Range |
| infer_name | String | Definition Deployment ID. |
| model | InferModelResponse object | Definition Model configuration. You can select a model and weight file to use with the image. Constraints N/A |
| advanced_config | AdvancedConfig object | Definition Advanced deployment settings. Constraints N/A |
| description | String | Definition Deployment description. |
| create_at | String | Definition Creation time, which is automatically generated. Range Millisecond-level timestamp, which is a 13-digit number, for example, 1609459200000. |
| schedule_strategy | String | Definition Scheduling policy. Range |
| Parameter | Type | Description |
|---|---|---|
| id | String | Definition Instance unit ID. Range N/A |
| name | String | Definition Instance unit name. Range N/A |
| role | String | Definition Instance unit role. Range |
| custom_spec | CustomResourceSpec object | Definition Custom resource specifications. |
| flavor | String | Definition Resource specifications. Select specifications based on service requirements. When specification is set to custom, the custom specifications are used. custom_spec specifies deployment specifications. Range N/A |
| image | ImageInfoResponse object | Definition Image configuration information, including the image path and image source. |
| models | Array of InferModelResponse objects | Definition Model configuration. You can select a model and weight file to use with the image. |
| files | Array of FileResponse objects | Definition Model and code configuration. You can select the model and weight file to work with the image and the OBS path where the code is stored. |
| codes | Array of CodeResponse objects | Definition Code configuration. You can select the OBS path where the code is stored. |
| dumps | Array of DumpResponse objects | Definition Dump configuration. You can select the OBS path where the data is to be dumped. |
| count | Integer | Definition Number of configuration instances. Range N/A |
| group_count | Integer | Definition Number of replicas in a unit. This parameter is invalid when deploy_type is set to SINGLE or workload_type is set to DEPLOYMENT. Range [1, 100] or left empty. Default Value 1 |
| cmd | String | Definition Startup command. Range N/A |
| envs | Map<String,String> | Definition Environment variable. |
| readiness_health | HealthResponse object | Definition Readiness health check. |
| startup_health | HealthResponse object | Definition Health checks are enabled. |
| liveness_health | HealthResponse object | Definition Liveness health check. |
| port | Integer | Definition Port. Range [1, 65535] |
| recovery | String | Definition Auto-rebuild policy. When enabled, the platform will automatically rebuild pods according to the policy if they restart due to deployment configuration changes or hardware failures. If disabled, the platform will not intervene. Range |
| npu_reset_enable | Boolean | Definition Specifies whether to enable the recovery policy. Range |
| affinity | AffinityResponse object | Definition Node affinity scheduling. |
| flavor_display_name | String | Definition Specification display name. This field is returned only for services deployed using the allocated specifications. Range N/A |
| termination_grace | TerminationGrace object | Definition Once enabled, you can configure shutdown timeouts and commands. This prevents in-progress requests from being forcibly interrupted, thereby enhancing the availability and stability of the system. Constraints The value can contain up to 255 characters. Range
Default Value N/A |
| security_config | ServiceSecurityConfig object | Definition Settings for starting the service container. Range N/A |
| pool_resource_flavor | String | Definition Node pool resource specifications. Constraints The value can contain only letters, digits, periods (.), hyphens (-), and underscores (_). Range The value can contain a maximum of 128 characters. Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| gpu | Float | Definition Number of GPUs. Constraints N/A Range The value can be a decimal. It cannot be smaller than 0, with the third decimal place is rounded off. Default Value N/A |
| memory | Integer | Definition Memory size, in MB. Constraints N/A Range Only integers are supported. Default Value N/A |
| cpu | Float | Definition CPU cores. Constraints N/A Range The value can be a decimal. It cannot be smaller than 0.01, with the third decimal place is rounded off. Default Value N/A |
| ascend | Integer | Definition Number of Ascend chips. Constraints N/A Range N/A Default Value N/A |
| arch | String | Definition Architecture type. Constraints N/A Range x86/arm64. Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| id | String | Definition Image ID. Range N/A |
| source | String | Definition Image type, which indicates the image source. Range |
| swr_path | String | Definition Image path. The address is different when the source value is different. Range N/A |
| category | String | Definition Flavors supported by the image. Range |
| Parameter | Type | Description |
|---|---|---|
| source | String | Definition Code source type. Constraints N/A Range The value is case-insensitive. Default Value N/A |
| address | String | Definition Code source address, which complies with the format of different storage systems. Constraints N/A Range N/A Default Value N/A |
| source_id | String | Definition Source ID. Constraints N/A Range N/A Default Value N/A |
| mount_path | String | Definition Path mounted to the container. The value must start with a slash (/) and can contain hyphens (-), backslashes (), underscores (), periods (.), letters, and digits. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores () are allowed. Default Value N/A |
| host_cache | Boolean | Definition Specifies whether the model can be cached locally. This function is disabled by default. Constraints N/A Range Default Value false |
| efs_sub_path | String | Definition When the storage type is EFS, subdirectories can be configured. Constraints N/A Range N/A Default Value N/A |
| read_only | Boolean | Definition Specifies whether the mount permission is read-only. Constraints N/A Range Default Value N/A |
| os_warm_up | Boolean | Definition OS warmup. Constraints N/A Range Default Value N/A |
| source_name | String | Definition Warmup name. Constraints This parameter is mandatory when os_warm_up is set to true. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| asset_id | String | Definition Preset asset ID. Constraints This parameter is mandatory when preset assets are used. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| source | String | Definition Code source type. Range |
| address | String | Definition Code source address, which complies with the format of different storage systems. Range N/A |
| mount_path | String | Definition Path mounted to the container. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| host_cache | Boolean | Definition Specifies whether the model can be cached locally. This function is disabled by default. Range |
| efs_sub_path | String | Definition When the storage type is EFS, subdirectories can be configured. Range N/A |
| read_only | Boolean | Definition Specifies whether the mount permission is read-only. Range |
| os_warm_up | Boolean | Definition OS warmup. Range |
| source_name | String | Definition Warmup name. Constraints This parameter is mandatory when os_warm_up is set to true. Range The value can contain at most 64 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| source | String | Definition Code source type. Range |
| address | String | Definition Code source address, which complies with the format of different storage systems. Range N/A |
| source_id | String | Definition Code source ID. Either this parameter or address must be specified. The SFS Turbo ID can be input only when source is set to EFS. Range N/A |
| mount_path | String | Definition Path mounted to the container. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| efs_sub_path | String | Definition EFS subpath. Range N/A |
| read_only | Boolean | Definition Specifies whether the mount permission is read-only. Range |
| Parameter | Type | Description |
|---|---|---|
| source | String | Definition Dump source type. Range |
| address | String | Definition Dump source address, which complies with the format of different storage systems. Range N/A |
| mount_path | String | Definition Path mounted to the container. The value must start with a slash (/) and can contain hyphens (-), backslashes (), underscores (_), periods (.), letters, and digits. Range N/A |
| type | String | Definition Transfer type. Range |
| Parameter | Type | Description |
|---|---|---|
| check_method | String | Definition Health check method, which can be HTTP or EXEC (commands). Constraints N/A Range Default Value N/A |
| cmd | String | Definition Command line when the health check method is EXEC. Constraints The value can contain 0 to 1,024 characters and cannot contain the following characters: #~^$|%&*<>()'"[]{} Range N/A Default Value N/A |
| url | String | Definition Request address when the health check mode is HTTP. Constraints The value can contain 0 to 1,024 characters. The first character must be a slash (/), and the subsequent characters can be letters, digits, hyphens (-), underscores (_), slashes (/), and colons (:). Range N/A Default Value N/A |
| protocol | String | Definition Connection protocol. The default value is HTTP. Constraints N/A Range Default Value N/A |
| initial_delay_seconds | Integer | Definition Waiting time before the first detection. The default value is 30 and the minimum value is 1. Constraints N/A Range N/A Default Value 30 |
| timeout_seconds | Integer | Definition Timeout interval of the detection. The default value is 30 seconds, and the minimum value is 1 second. Constraints N/A Range The minimum value is 1 second. Default Value 30s |
| period_seconds | Integer | Definition Interval at which the health check is performed. The default value is 10 seconds, and the minimum value is 1 second. Constraints N/A Range The minimum value is 1 second. Default Value 10s |
| failure_threshold | Integer | Definition The minimum number of consecutive detection failures required after a successful detection. Detection is considered failed only when this threshold is reached. The default value is 3. The minimum value is 1. Constraints N/A Range The minimum value is 1. Default Value 3 |
| Parameter | Type | Description |
|---|---|---|
| affinity_type | String | Definition Node affinity type. Range |
| required | Boolean | Definition Specifies whether to set strong affinity. Range |
| selection_mode | String | Definition Node selection mode. Range IP |
| targets | Map<String,String> | Definition List selected using the preceding method, whose length cannot exceed 20. |
| Parameter | Type | Description |
|---|---|---|
| user_id | Long | Definition user_id set during service container startup. This parameter can be left empty by default. Range [1, 60000] |
| group_id | Long | Definition group_id set during service container startup. This parameter can be left empty by default. Range [1, 60000] |
| Parameter | Type | Description |
|---|---|---|
| deploy_timeout_minutes | String | Definition Deployment timeout. |
| upgrade_config | UpgradeConfig object | Definition Rolling upgrade configuration. |
| service_secret | ServiceSecret object | Definition Service secret. |
| dynamic_routing_enable | Boolean | Definition Intelligent routing switch. |
| strategy | String | Definition Intelligent routing policy. |
| ems_enable | Boolean | Definition EMS acceleration switch. |
| metric_api_scheme | String | Definition Intelligent routing metric collection scheme. |
| metric_api_port | String | Definition Intelligent routing metric collection port. |
| metric_api_path | String | Definition Intelligent routing metric collection URL. |
| custom_metrics_path | String | Definition Custom metric collection URL. |
| port | Integer | Definition Container port. |
| protocol | String | Definition Container request protocol. When WSS or WS is selected, the service API is upgraded to WebSocket. WebSocket cannot be enabled together with Traffic Limit. Range |
| Parameter | Type | Description |
|---|---|---|
| type | String | Definition Upgrade type. Constraints N/A Range Default Value N/A |
| rolling_update | RollingUpdate object | Definition Rolling update configuration. Constraints N/A |
| Parameter | Type | Description |
|---|---|---|
| max_surge | String | Definition Maximum number of pods that can be started during rolling update. Constraints A percentage-type string. Range 1/ %to 100% Default Value 1%. |
| max_unavailable | String | Definition Maximum number of pods that can be deleted during rolling update. Constraints A percentage-type string. Range 1/ %to 100% Default Value 1%. |
| Parameter | Type | Description |
|---|---|---|
| secret_enable | Boolean | Definition Specifies whether to enable the key. Constraints N/A Range Default Value false |
| secret_type | String | Definition Secret type. Constraints N/A Range Default Value N/A |
| secret_volumes | Array of SecretVolume objects | Definition Secret volume mounting. Constraints Maximum: 30 |
| group_enable | Boolean | Definition Specifies whether to enable the image user group. Constraints N/A Range Default Value false |
| group_id | Long | Definition User group ID of the image. Constraints N/A Range 1000 to 4294967294 Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| secret_name | String | Definition Secret name. Constraints N/A Range N/A Default Value N/A |
| secret_key | String | Definition Secret key. Constraints A string of 1 to 63 characters is matched. Only letters, digits, dots (.), underscores (_), and hyphens (-) are allowed. The string cannot start with two consecutive dots (..). Range N/A Default Value N/A |
| secret_value | String | Definition Secret value. Constraints The value is a Base64-encoded secret value and contains 1 to 32,768 characters. Range N/A Default Value N/A |
| mount_path | String | Definition Mount path. Constraints N/A Range The value must start and end with a slash (/) and can contain at most 255 characters. Only letters, digits, hyphens (-), and underscores (_) are allowed. Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| type | String | Definition Log output type. Range |
| status | String | Definition Log service status. Range |
| log_group_id | String | Definition Log group ID. You can select an existing log group. If this parameter is left blank, a log group is automatically created. Constraints N/A Range N/A Default Value N/A |
| log_stream_id | String | Definition Log stream ID. You can select an existing log group. If this parameter is left blank, the system automatically creates one. Constraints N/A Range N/A Default Value N/A |
| deployment_id | String | Definition ID of the deployment corresponding to the log stream. This parameter has a value when the log policy is default or pool. Constraints N/A Range N/A Default Value N/A |
| Parameter | Type | Description |
|---|---|---|
| type | String | Definition Access mode. Range |
| urls | Array of strings | Definition Access address of an inference request. This parameter is only valid when type is set to REAL_TIME and the service is deployed. |
| Parameter | Type | Description |
|---|---|---|
| key | String | Definition Tag key field. Range The value can contain letters, digits, underscores (_), periods (.), equal signs (=), plus signs (+), minus signs (-), and at signs (@), and cannot start with a space or sys or end with a space. Range: 1 to 128. |
| value | String | Definition Tag value field. Range The value can contain 255 characters. Only letters, digits, underscores (_), periods (.), slashes (/), equal signs (=), plus signs (+), minus signs (-), and at signs (@) are allowed. |
| Parameter | Type | Description |
|---|---|---|
| due_time | Long | Definition Trigger time. The value is a 13-digit timestamp, UTC time, in milliseconds. Range N/A |
| duration | Integer | Definition Value mapping a time unit. Range N/A |
| time_unit | String | Definition Scheduling time unit. Range |
| type | String | Definition Scheduling type. Only the value STOP is supported. Range |
| processed | Boolean | Definition Indicates whether the processing is complete. Range |
Example Requests
Modify service configurations.
PUT https://{endpoint}/v2/{project_id}/services/{service_id}/deployments/{deployment_id}
{
"description" : null,
"name" : "deployment-example",
"weight" : 100,
"pool_id" : "pool-example",
"count" : 1,
"advanced_config" : {
"upgrade_config" : {
"rolling_update" : {
"max_surge" : "1%",
"max_unavailable" : "1%"
},
"type" : "ROLLING"
},
"port" : 0,
"protocol" : "HTTPS"
}
} Example Responses
Status code: 200
Service configuration modified.
{
"id" : "8a927efb-43f6-4a0b-8222-a1b87d2d2fa8",
"name" : "deployment-example",
"version" : "0.0.1",
"status" : "DEPLOYING"
} Status Codes
| Status Code | Description |
|---|---|
| 200 | Service configuration modified. |
Error Codes
See Error Codes.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot