Help Center/ ModelArts/ API Reference/ Training Management/ Querying a Training Job List
Updated on 2026-07-24 GMT+08:00

Querying a Training Job List

Function

This API is used to obtain the list of all training jobs on ModelArts.

This API applies to the following scenarios: When you need to view all training jobs on the platform, you can use this API to obtain the job list. Before using this API, ensure that you have the permission to view the training job list. After the query is complete, the platform returns a training job list. Information such as the training job name, ID, and status is displayed. If you do not have the permission to perform operations, the API will return an error message.

Debugging

You can debug this API through automatic authentication in API Explorer or use the SDK sample code generated by API Explorer.

Authorization Information

Each account has all the permissions required to call all APIs, but IAM users must be assigned the required permissions.

  • If you are using role/policy-based authorization, see Permissions Policies and Supported Actions for details on the required permissions.
  • If you are using identity policy-based authorization, the following identity policy-based permissions are required.

    Action

    Access Level

    Resource Type (*: required)

    Condition Key

    Alias

    Dependencies

    modelarts:trainJob:list

    List

    -

    -

    -

    -

URI

POST /v2/{project_id}/training-job-searches

Table 1 Path Parameters

Parameter

Mandatory

Type

Description

project_id

Yes

String

Definition: Project ID. For details, see Obtaining a Project ID and Name.

Constraints: N/A

Range: The value can contain 1 to 64 characters. Only letters, digits, and hyphens (-) are allowed.

Default Value: N/A

Request Parameters

Table 2 Request body parameters

Parameter

Mandatory

Type

Description

workspace_id

No

String

Definition: Workspace ID.

Constraints: N/A.

Range: 0 or a string of 32 characters.

Default Value: 0

offset

No

Integer

Definition: Number of pages for querying jobs.

Constraints: The minimum value is 0. For example, if this parameter is set to 0, the query starts from the first page.

Range: N/A

Default Value: N/A

limit

No

Integer

Definition: Number of records on each page for querying jobs.

Constraints: The value ranges from 1 to 50.

Range: N/A

Default Value: N/A

sort_by

No

String

Definition: Metric for sorting jobs to be queried.

Constraints: N/A.

Range: N/A.

Default Value: create_time is used for sorting by default.

order

No

String

Definition: Order of queried jobs.

Constraints: N/A

Range:

  • asc: ascending order

  • desc: descending order.

Default Value: desc

group_by

No

String

Definition: Condition for grouping the jobs to be queried.

Constraints: N/A

Range: The value is algorithm_name, indicating that jobs are queried by algorithm name.

Default Value: N/A

train_type

No

String

Definition: When the joint query of custom jobs and fine-tuning jobs is enabled, only custom jobs or fine-tuning jobs are displayed.

Constraints: N/A.

Range:

  • job: Only custom jobs are queried.

  • ftjob: Only fine-tuning jobs are queried.

Default Value: N/A.

filters

No

Array of Filter objects

Definition: Criteria for filtering jobs.

Constraints: The length range is [0, 20].

Table 3 Filter

Parameter

Mandatory

Type

Description

key

No

String

Definition: Key of the grouping condition.

Constraints: N/A.

Range:

  • id: Training job ID

  • name: Training job name

  • kind: Training job type

  • phase: Training job status

  • algorithm_id: Algorithm ID

  • algorithm_name: Algorithm name

  • create_time: Creation time

  • user_id: User ID

  • pool_id: Resource pool ID

  • training_experiment_id: Experiment ID

  • runtime_type: Job mode

  • priority: Job priority

Default Value: N/A.

operator

No

String

Definition: Grouping condition key operators.

Constraints: N/A

Range:

  • between: a range

  • in: include

  • not: not

like: similar

Default Value: N/A

value

No

Array of strings

Definition: Value of the grouping condition key.

Constraints: The maximum value of the creation time filter is 31 days.

Range: The array contains a maximum of 10 values. The array content can contain 0 to 256 characters.

Default Value: N/A

Response Parameters

Status code: 200

Table 4 Response body parameters

Parameter

Type

Description

total

Integer

Definition: Total number of training jobs of the current user.

Range: N/A

count

Integer

Definition: Total number of training jobs that meet the search criteria of the current user.

Range: N/A

limit

Integer

Definition: Number of records on each page for querying jobs. The value ranges from 1 to 50.

Range: N/A

offset

Integer

Definition: Number of pages for querying jobs. The minimum value is 0. For example, if this parameter is set to 0, the query starts from the first page.

Range: N/A

sort_by

String

Definition: Metric for sorting jobs to be queried create_time is used by default.

Range: N/A

order

String

Definition: Order of queried jobs. The default value is desc, indicating the descending order. You can also set this parameter to asc, indicating the ascending order.

Range: N/A

group_by

String

Definition: Condition for grouping the jobs to be queried

Range: N/A

workspace_id

String

Definition: Workspace where a training job is deployed. The default value is 0.

Range: N/A

ai_project

String

Definition: AI project to which a job belongs. The default value is default-ai-project.

Range: N/A

train_type

String

Definition: When the joint query of custom jobs and fine-tuning jobs is enabled, only custom jobs or fine-tuning jobs are displayed.

Range:

- job: Only custom jobs are queried.

- ftjob: Only fine-tuning jobs are queried.

items

Array of JobResponse objects

Definition: Details of the training jobs that meet the search criteria of the current user.

Table 5 JobResponse

Parameter

Type

Description

kind

String

Definition: Type of a training job.

Range

  • job: common job

  • federated_pool_job: resource pool federated job

  • edge_job: edge job

  • hetero_job: heterogeneous job

  • mrs_job: MRS job

  • autosearch_job: auto search job

  • diag_job: diagnosis job

  • visualization_job: visualization job

metadata

JobMetadataResponse object

Definition: Training job metadata.

status

Status object

Definition: Training job status information.

algorithm

JobAlgorithmResponse object

Definition: Training job algorithm.

tasks

Array of TaskResponse objects

Definition: Heterogeneous training tasks.

spec

SpecResponse object

Definition: Training job specifications.

endpoints

JobEndpointsResp object

Definition: Configurations required for remotely accessing a training job.

ftjob_config

MasJobConfig object

Definition: Fine-tuning training job parameters.

Table 6 JobMetadataResponse

Parameter

Type

Description

id

String

Definition: Training job ID, which is generated and returned by ModelArts after a training job is created.

Range: N/A

name

String

Definition: Name of a training job.

Range: The value must contain 1 to 64 characters consisting of only digits, letters, underscores (_), and hyphens (-).

workspace_id

String

Definition: Workspace where a specified job is located.

Range: N/A

description

String

Definition: Definition of a training job.

Range: N/A

create_time

Long

Definition: Time when a training job was created, in milliseconds. The value is generated and returned by ModelArts after a training job is created.

Range: N/A

user_name

String

Definition: Username for creating a training job. The username is generated and returned by ModelArts after a training job is created.

Range: N/A

annotations

Map<String,String>

Definition: advanced function configuration of a training job. The key is the function switch/configuration name, and the value is a string. (Even if the value is a number or Boolean value, it is represented by a string, for example, "true" or "3".)

training_experiment_reference

TrainingExperimentResp object

Definition: Training experiment parameters.

Table 7 TrainingExperimentResp

Parameter

Type

Description

name

String

Definition: Experiment name.

Range: The value can contain a maximum of 64 characters. Special characters are not allowed.

id

String

Parameter Explanation: Experiment ID.

Value Range: N/A.

serial_number

String

Definition: sequence number of the current training job in the training experiment to which the job belongs. The default value is 0.

Table 8 Status

Parameter

Type

Description

phase

String

Definition: Level-1 status of a training job.

Range:

  • Creating: The job is being created.

  • Pending: The job is pending.

  • Running: The job is running.

  • Failed: The job failed to run.

  • Completed: The job is complete.

  • Terminating: The job is being stopped.

  • Terminated: The job has been stopped.

  • Abnormal: The job is abnormal.

secondary_phase

String

Definition: Level-2 status of a training job. The values are internal detailed statuses and may be added, changed, or deleted. Dependency on the status is not recommended.

Range:

  • Creating: The job is being created.

  • Queuing: The job is queuing.

  • Running: The job is running.

  • Failed: The job failed to run.

  • Completed: The job is complete.

  • Terminating: The job is being stopped.

  • Terminated: The job has been stopped.

  • CreateFailed: The job fails to be created.

  • TerminatedFailed: The job fails to be stopped.

  • Unknown: The job is in an unknown state.

  • Lost: The job is abnormal.

duration

Long

Definition: Running duration of a training job, in ms.

Range: N/A

node_count_metrics

Array<Array<Integer>>

Definition: number of nodes during training job running. Each inner array indicates a [time point, number of running nodes] 2-tuple, which records the number of nodes running at a specific time point.

tasks

Array of strings

Definition: Training job subtask name.

start_time

Long

Definition: training job start time. The value is a Unix timestamp, in milliseconds.

Range: N/A

task_statuses

Array of TaskStatuses objects

Definition: Status of the first failed subtask of a training job.

running_records

Array of RunningRecord objects

Definition: Running and fault recovery records of a training job.

Table 9 TaskStatuses

Parameter

Type

Description

task

String

Definition: Training job subtask name.

Range: N/A

exit_code

Integer

Definition: Exit code of a training job subtask.

Range: N/A

message

String

Definition: Error message of a training job subtask.

Range: N/A

Table 10 RunningRecord

Parameter

Type

Description

start_at

Long

Definition: Unix timestamp of the start time in the current running record, in seconds.

Range: N/A

end_at

Long

Definition: Unix timestamp of the end time in the current running record, in seconds.

Range: N/A

xpu_start_at

Long

Definition: Unix timestamp of the accelerator card startup time in the current running record, in seconds.

Range: N/A

start_type

String

Definition: Startup mode of the current execution.

Range

  • init_or_rescheduled: This startup is the first running after scheduling, including the first startup and the running after scheduling recovery.

  • restarted: This startup is not the first running after scheduling but the running after a process restart.

end_reason

String

Definition: Reason why the running ends.

Range: N/A

end_related_task

String

Definition: ID of the task worker (for example, worker-0) that ends the running.

Range: N/A

end_recover

String

Definition: Fault tolerance policy adopted when the execution ends abnormally.

Range

  • npu_proc_restart: NPU in-place hot recovery

  • proc_restart: in-place process recovery

  • npu_step_retry: step recomputation

  • pod_reschedule: pod-level rescheduling

  • job_reschedule: job-level rescheduling

  • job_reschedule_with_taint: isolated job-level rescheduling

end_recover_before_downgrade

String

Definition: There is a downgrade relationship between policies. If a policy fails to be executed, it will be downgraded to another specified policy. end_recover_before_downgrade indicates the tolerance policy used before end_recover is downgraded.

Range: same as that of end_recover.

recover_records

Array of RecoverRecord objects

Definition: details about all fault tolerance policies adopted when the execution ends abnormally.

Table 11 RecoverRecord

Parameter

Type

Description

recover_start_at

Long

Definition: Unix timestamp of the start time of the fault tolerance policy, in seconds. The timestamp is also the fault occurrence time.

Range: N/A

recover_end_at

Long

Definition: Unix timestamp of the end time of the fault tolerance policy, in seconds.

Range: N/A

recover

String

Definition: Fault tolerance policy.

Range

  • npu_step_retry: step recomputation

  • npu_proc_restart: NPU in-place hot recovery

  • proc_restart: in-place process recovery

  • pod_reschedule: pod-level rescheduling

  • job_reschedule: job-level rescheduling

  • job_reschedule_with_taint: isolated job-level rescheduling

fault_scenario

String

Definition: Fault scenario.

Range

  • chip_fault: chip fault

  • node_fault: node fault

  • job_failed: job exit upon a failure

  • job_hanged: job suspension

  • job_subhealth: job subhealth

  • error_in_log: log exception

reason

String

Definition: Fault cause.

Range: N/A

related_task

String

Definition: ID of the task worker (for example, worker-0) that ends the running.

Range: N/A

recover_result

String

Definition: Fault recovery result.

Range

  • recovering

  • success

  • failed

  • downgrade: policy downgrade

  • terminated: The policy is terminated.

  • quotaExceeded: The number of policy executions exceeds the limit.

Table 12 JobAlgorithmResponse

Parameter

Type

Description

id

String

Definition: algorithm ID of a training job.

name

String

Definition: Algorithm name.

Range: N/A

subscription_id

String

Definition: Subscription ID of a subscription algorithm, which must be used with item_version_id.

Range: N/A

item_version_id

String

Definition: Version of a subscription algorithm, which must be used with subscription_id.

Range: N/A

code_dir

String

Definition: Code directory of a training job, for example, /usr/app/. This parameter must be used with boot_file. Leave this parameter blank if id, or subscription_id and item_version_id are specified.

Range: N/A

boot_file

String

Definition: Boot file of a training job, which must be stored in the code directory, for example, /usr/app/boot.py. This parameter must be used with code_dir. Leave this parameter blank if id, or subscription_id and item_version_id are specified.

Range: N/A

autosearch_config_path

String

Definition: YAML configuration path of an auto search job. An OBS URL is required. For example, obs://bucket/file.yaml.

Range: N/A

autosearch_framework_path

String

Definition: Framework code directory of an auto search job. An OBS URL is required. For example, obs://bucket/files/.

Range: N/A

command

String

Definition: Boot command for starting the container of a custom image for a training job. For example, python train.py.

Range: N/A

parameters

Array of ParameterResp objects

Definition: Running parameters of the training job.

policies

policies object

Definition: Policy supported by a job.

inputs

Array of InputResp objects

Definition: Data input of a training job.

outputs

Array of OutputResp objects

Definition: Output of the training job.

engine

JobEngineResp object

Definition: Engine of a training job. Leave this parameter blank if the job is created using id of the algorithm in algorithm management, or subscription_id+item_version_id of the subscribed algorithm.

local_code_dir

String

Definition: Local directory of the training container to which the algorithm code directory is downloaded. The rules are as follows:

  • The directory must be under /home.

  • In v1 compatibility mode, the current field does not take effect.

  • When code_dir is prefixed with file://, the current field does not take effect.

Range: N/A

working_dir

String

Definition: Work directory where an algorithm is executed. Rules:

In v1 compatibility mode, this parameter does not take effect.

Range: N/A

environments

Array of Map<String,String> objects

Definition: Environment variables of a training job. The format is key:value. Leave this parameter blank.

summary

SummaryResp object

Definition: Visualization log summary.

Table 13 ParameterResp

Parameter

Type

Description

name

String

Definition: Parameter name.

Range: N/A

value

String

Definition: Parameter value.

Range: N/A

description

String

Definition: Parameter description.

Range: N/A

constraint

constraint object

Definition: Parameter attribute.

i18n_description

i18n_description object

Definition: Internationalization description.

Table 14 constraint

Parameter

Type

Description

type

String

Definition: Parameter type.

Range:

  • Integer: Integer

  • Float: Floating point number

  • String: String

  • Boolean: Boolean value

editable

Boolean

Definition: Whether the parameter can be edited.

Range:

  • true: editable

  • false: Not uneditable

required

Boolean

Definition: Whether the parameter is mandatory.

Range:

  • true: mandatory

  • false: optional

sensitive

Boolean

Definition: Whether the parameter is sensitive. This function is unavailable currently.

Range:

  • true: sensitive

  • false: insensitive

valid_type

String

Definition: Valid type.

Range:

- Choice: Enumerated values

- Range: Range values

- None: None

valid_range

Array of strings

Definition: Valid range.

Table 15 i18n_description

Parameter

Type

Description

language

String

Definition: Internationalization language. The options are as follows:

  • zh-cn: Chinese

  • en-us: English](tag:hc,hk)

Range: N/A

description

String

Definition: Internationalization language description.

Range: N/A

Table 16 policies

Parameter

Type

Description

auto_search

auto_search object

Definition: Hyperparameter search configuration.

Table 18 reward_attrs

Parameter

Type

Description

name

String

Definition: Metric name.

Range: N/A

mode

String

Definition: Search mode.

Range:

  • max: A larger metric value is preferred.

  • min: A smaller metric value is preferred.

regex

String

Definition: Regular expression of a metric.

Range: N/A

Table 19 search_params

Parameter

Type

Description

name

String

Definition: Hyperparameter name.

Range: N/A

param_type

String

Definition: Parameter type.

Range:

  • continuous: The hyperparameter is of the continuous type. When an algorithm is used in a training job, continuous hyperparameters are displayed as text boxes on the console.

  • discrete: The hyperparameter is of the discrete type. When an algorithm is used in a training job, discrete hyperparameters are displayed as drop-down lists on the console.

lower_bound

String

Definition: Lower bound of the hyperparameter.

Range: N/A

upper_bound

String

Definition: Upper bound of the hyperparameter.

Range: N/A

discrete_points_num

String

Definition: Number of discrete points of a hyperparameter with continuous values.

Range: N/A

discrete_values

Array of strings

Definition: Discrete hyperparameter values.

Table 20 algo_configs

Parameter

Type

Description

name

String

Definition: Search algorithm name.

Range: N/A

params

Array of AutoSearchAlgoConfigParameterResp objects

Definition: Search algorithm parameters.

Table 21 AutoSearchAlgoConfigParameterResp

Parameter

Type

Description

key

String

Definition: Parameter key.

Range: N/A

value

String

Definition: Parameter value.

Range: N/A

type

String

Definition: Parameter type.

Range:

  • obs: Data storage location (OBS)

  • modelarts_dataset: ModelArts dataset

Table 22 InputResp

Parameter

Type

Description

name

String

Definition: Name of the data input channel.

Range: N/A

description

String

Definition: Description of the data input channel.

Range: N/A

local_dir

String

Definition: Local path of the container to which the data input channels are mapped. Example: /home/ma-user/modelarts/inputs/data_url_0

Range: N/A

access_method

String

Definition: Access method of the input data channel path (local_dir).

Range:

  • parameter: hyperparameters

  • env: environment variables

remote

InputDataInfoResp object

Definition: Description of the actual data input.

remote_constraint

Array of remote_constraint objects

Definition: Data input constraint.

Table 23 InputDataInfoResp

Parameter

Type

Description

dataset

dataset object

Definition: The input is a dataset. Both the new and old dataset functions are supported. The old dataset function will be brought offline. You are advised to use the new dataset function.

obs

obs object

Definition: OBS in which data input and output are stored.

Table 24 dataset

Parameter

Type

Description

id

String

Definition: Dataset ID of a training job.

Range: N/A

version_id

String

Definition: Dataset version ID of a training job.

Range: N/A

obs_url

String

Definition: OBS URL of the dataset for a training job. It is automatically parsed by ModelArts based on the dataset ID and dataset version ID. For example, /usr/data/.

Range: N/A

service_type

String

Definition: Dataset service type.

name

String

Definition: Dataset name of a training job.

Range: N/A

Table 25 obs

Parameter

Type

Description

obs_url

String

Definition: OBS URL of the dataset for a training job, For example, /usr/data/.

Range: N/A

Table 26 remote_constraint

Parameter

Type

Description

data_type

String

Definition: data input type, which can be data storage location or dataset. The dataset function will be brought offline soon.

attributes

String

Definition: Related attributes.

Range

If the input is a dataset:

  • data_format: data format

  • data_segmentation: data segmentation method

  • dataset_type: data labeling type

Table 27 OutputResp

Parameter

Type

Description

name

String

Definition: Name of the data output channel.

Range: N/A

description

String

Definition: Description of the data output channel.

Range: N/A

local_dir

String

Definition: Local path of the container to which the data output channels are mapped.

Range: N/A

access_method

String

Definition: Access method of the input data channel path (local_dir).

Range:

  • parameter: hyperparameters

  • env: environment variables

remote

RemoteResp object

Definition: Description of the actual data output.

Table 28 JobEngineResp

Parameter

Type

Description

engine_id

String

Definition: Engine ID selected for a training job.

Range: N/A

engine_name

String

Definition: Engine name selected for a training job.

Range: N/A

engine_version

String

Definition: Engine version selected for a training job.

Range: N/A

image_url

String

Definition: Custom image URL selected for a training job. The URL is obtained from SWR.

Range: N/A

install_sys_packages

Boolean

Definition: Specifies whether to install the MoXing version specified by the training platform.

Range:

  • true: yes

  • false: no

Table 29 SummaryResp

Parameter

Type

Description

log_type

String

Definition: Visualization log type of a training job. After this parameter is configured, the training job can be used as the data source of a visualization job.

Range:

  • tensorboard: Logs of the TensorBoard visualization tool type.

  • mindstudio-insight: Logs of the MindStudio Insight visualization tool type.

log_dir

LogDirResp object

Definition: Visualization log output of a training job.

data_sources

Array of DataSourceResp objects

Definition: Visualization log input of the visualization job or training job debugging mode.

Table 30 LogDirResp

Parameter

Type

Description

pfs

PFSSummaryResp object

Definition: Output of an OBS parallel file system.

Table 31 PFSSummaryResp

Parameter

Type

Description

pfs_path

String

Definition: URL of the OBS parallel file system.

Range: N/A

Table 32 DataSourceResp

Parameter

Type

Description

job

JobSummaryResp object

Definition: Job data source.

Table 33 JobSummaryResp

Parameter

Type

Description

job_id

String

Definition: ID of a training job.

Range: N/A

Table 34 TaskResponse

Parameter

Type

Description

role

String

Definition: Task role. This function is not supported currently.

Range: N/A

algorithm

TaskResponseAlgorithm object

Definition: Algorithm configurations for algorithm management.

task_resource

FlavorResponse object

Definition: Specifications of a training job or algorithm.

log_export_path

log_export_path object

Definition: Saved information about training job logs.

Table 35 TaskResponseAlgorithm

Parameter

Type

Description

code_dir

String

Definition: Absolute path of the directory where the algorithm boot file is stored.

Range: N/A

boot_file

String

Definition: Absolute path of an algorithm boot file.

Range: N/A

inputs

AlgorithmInput object

Definition: Information about the algorithm input channel.

outputs

AlgorithmOutput object

Definition: Information about the algorithm output channel.

engine

AlgorithmEngine object

Definition: Engine that a heterogeneous job depends on.

local_code_dir

String

Definition: Local directory of the training container to which the algorithm code directory is downloaded. The rules are as follows:

  • The directory must be under /home.

  • In v1 compatibility mode, the current field does not take effect.

  • When code_dir is prefixed with file://, the current field does not take effect.

Range: N/A

working_dir

String

Definition: Work directory where an algorithm is executed. Note that this parameter does not take effect in v1 compatibility mode.

Range: N/A

environments

Map<String,String>

Definition: Environment variables related to a training job.

Range: N/A

Table 36 AlgorithmInput

Parameter

Type

Description

name

String

Definition: Name of the data input channel.

Range: N/A

local_dir

String

Definition: Local path of the container to which the data input and output channels are mapped.

Range: N/A

remote

AlgorithmRemote object

Definition: Actual data input, which can only be OBS for heterogeneous jobs.

Table 37 AlgorithmRemote

Parameter

Type

Description

obs

RemoteObsResp object

Definition: OBS in which data input and output are stored.

Table 38 AlgorithmOutput

Parameter

Type

Description

name

String

Definition: Name of the data output channel.

Range: N/A

local_dir

String

Definition: Local path of the container to which the data output channels are mapped.

Range: N/A

remote

RemoteResp object

Definition: Description of the actual data output.

mode

String

Definition: Data transmission mode. The default value is upload_periodically.

Range: N/A

period

String

Definition: Data transmission period. The default value is 30s.

Range: N/A

Table 39 RemoteResp

Parameter

Type

Description

obs

RemoteObsResp object

Definition: Data actually output to OBS.

Table 40 RemoteObsResp

Parameter

Type

Description

obs_url

String

Definition: Data is actually output to the OBS path, for example, obs://example/path.

Range: N/A

Table 41 AlgorithmEngine

Parameter

Type

Description

engine_id

String

Definition: Engine flavor ID, for example, caffe-1.0.0-python2.7.

Range: N/A

engine_name

String

Definition: Engine flavor name, for example, Caffe.

Range: N/A

engine_version

String

Definition: Engine flavor version. Engines with the same name have multiple versions, for example, Caffe-1.0.0-python2.7 of Python 2.7.

Range: N/A

v1_compatible

Boolean

Definition: Specifies whether the v1 compatibility mode is used.

Range:

  • true: The v1 compatibility mode is used.

  • false: The v1 compatibility mode is not used.

run_user

String

Definition: Default UID for the engine startup.

Range: N/A

image_url

String

Definition: Custom image URL selected for an algorithm, for example, train-image/pytorch_2_1_xxx:1.0.1. The URL is obtained from SWR.

Range: N/A

Table 42 FlavorResponse

Parameter

Type

Description

pool_id

String

Definition: ID of the resource pool selected for a training job.

Range: N/A

flavor_id

String

Definition: Resource flavor ID.

Range: N/A

flavor_name

String

Definition: Resource flavor name.

Range: N/A

max_num

Integer

Definition: Maximum number of nodes supported by a flavor.

Range: N/A

flavor_type

String

Definition: Resource flavor type.

Range:

  • CPU: CPU resource specifications

  • GPU: GPU resource specifications

  • Ascend: NPU resource specifications

billing

BillingInfo object

Definition: Billing information of a resource flavor.

flavor_info

FlavorInfoResponse object

Definition: Resource flavor details.

attributes

Map<String,String>

Definition: Other flavor attributes.

Range: N/A

Table 43 FlavorInfoResponse

Parameter

Type

Description

max_num

Integer

Definition: Maximum number of nodes that can be selected. The value 1 indicates that the distributed mode is not supported.

Range: N/A

cpu

Cpu object

Definition: CPU specifications.

gpu

Gpu object

Definition: GPU specifications.

npu

Npu object

Definition: Ascend specifications.

memory

Memory object

Definition: Memory information.

disk

DiskResponse object

Definition: Disk information.

Table 44 DiskResponse

Parameter

Type

Description

size

Integer

Definition: Disk size.

Range: N/A

unit

String

Definition: Unit of the disk size.

Range: N/A

Table 45 log_export_path

Parameter

Type

Description

obs_url

String

Definition: OBS path for storing training job logs.

Table 46 SpecResponse

Parameter

Type

Description

resource

Resource object

Definition: Resource flavor of a training job. Select either flavor_id or pool_id and flavor_id.

volumes

Array of JobVolumeResp objects

Definition: Mounting volume information of a training job.

log_export_path

LogExportPathResp object

Definition: Log output of a training job.

schedule_policy

SchedulePolicyResp object

Definition: Scheduling policy of a training job.

custom_metrics

Array of CustomMetrics objects

Definition: Metric collection configuration.

output_model

OutputModelResp object

Definition: Output information of a custom training job.

asset_model

AssetModelResp object

Definition: Information about the model created using a custom training job.

Table 47 Resource

Parameter

Type

Description

policy

String

Definition: Resource flavor mode of a training job.

Range:

  • regular: standard mode

flavor_id

String

Definition: Resource flavor ID of a training job. flavor_id cannot be specified for CPU-based dedicated resource pools.

Range: The options for GPU- or Ascend-based dedicated resource pools are as follows:

  • modelarts.pool.visual.xlarge (1 PU)

  • modelarts.pool.visual.2xlarge (2 PUs)

  • modelarts.pool.visual.4xlarge (4 PUs)

  • modelarts.pool.visual.8xlarge (8 PUs)

flavor_name

String

Definition: Read-only flavor name returned by ModelArts when flavor_id is used.

Range: N/A

node_count

Integer

Definition: Number of resource replicas selected for a training job.

Range: greater than or equal to 1

pool_id

String

Definition: ID of the resource pool selected for a training job.

Range: N/A

pool_group_id

String

Definition: ID of the resource pool federation selected for a training job.

Range: N/A

flavor_detail

FlavorDetail object

Definition: Flavor details of a training job or algorithm. This parameter is available only for public resource pools.

main_container_allocated_resources

MainContainerAllocatedResources object

Definition: Resource specifications actually obtained by the training container of a training job.

main_container_customized_flavor

MainContainerCustomizedFlavor object

Definition: Custom flavor of a training job.

Table 48 FlavorDetail

Parameter

Type

Description

flavor_type

String

Definition: Resource flavor type.

Range:

  • CPU: CPU resource specifications

  • GPU: GPU resource specifications

  • Ascend: NPU resource specifications

billing

BillingInfo object

Definition: Billing information of a resource flavor.

flavor_info

FlavorInfo object

Definition: Resource flavor details.

Table 49 BillingInfo

Parameter

Type

Description

code

String

Definition: Billing code.

Range: N/A

unit_num

Integer

Definition: Billing unit.

Range: N/A

Table 50 FlavorInfo

Parameter

Type

Description

max_num

Integer

Definition: Maximum number of nodes that can be selected. The value 1 indicates that the distributed mode is not supported.

Range: N/A

cpu

Cpu object

Definition: CPU specifications.

gpu

Gpu object

Definition: GPU specifications.

npu

Npu object

Definition: Ascend specifications.

memory

Memory object

Definition: Memory information.

disk

Disk object

Definition: Disk information.

Table 51 Cpu

Parameter

Type

Description

arch

String

Definition: CPU architecture.

Range: N/A

core_num

Integer

Definition: Number of cores.

Range: N/A

Table 52 Gpu

Parameter

Type

Description

unit_num

Integer

Definition: Number of GPUs.

Range: N/A

product_name

String

Definition: Product name.

Range: N/A

memory

String

Definition: Memory size, in GB.

Range: N/A

Table 53 Npu

Parameter

Type

Description

unit_num

String

Definition: Number of NPUs.

Range: N/A

product_name

String

Definition: Product name.

Range: N/A

memory

String

Definition: Memory.

Range: N/A

Table 54 Memory

Parameter

Type

Description

size

Integer

Definition: Memory size.

Range: N/A

unit

String

Definition: Number of memory units.

Range: N/A

Table 55 Disk

Parameter

Type

Description

size

String

Definition: Disk size.

Range: N/A

unit

String

Definition: Unit of the disk size. Generally, the unit is GB.

Range: N/A

Table 56 MainContainerAllocatedResources

Parameter

Type

Description

cpu_arch

String

Definition: CPU architecture.

Range: N/A

cpu_core_num

Float

Definition: Number of cores.

Range: N/A

mem_size

Float

Definition: Memory information.

Range: N/A

accelerator_num

Float

Definition: Number of accelerator cards.

Range: N/A

accelerator_type

String

Definition: Type of accelerator cards. For example, ascend-d910b and ascend-snt9c.

Range: N/A

Table 57 MainContainerCustomizedFlavor

Parameter

Type

Description

cpu_core_num

Float

Definition: Number of CPU cores.

Range: greater than 0

Constraints: N/A

Default Value: N/A

mem_size

Float

Definition: Memory size, in GB.

Range: greater than 0

Constraints: N/A

Default Value: N/A

accelerator_num

Float

Definition: Number of accelerator cards.

Range: greater than or equal to 0

Constraints: N/A

Default Value: N/A

Table 58 JobVolumeResp

Parameter

Type

Description

nfs

NfsResp object

Definition: Volumes attached in NFS mode.

Table 59 NfsResp

Parameter

Type

Description

nfs_server_path

String

Definition: NFS server path, for example, 10.10.10.10:/example/path.

Range: N/A

local_path

String

Definition: Path for attaching volumes to the training container, for example, /example/path.

Range: N/A

read_only

Boolean

Definition: Specifies whether the disks attached to the container in NFS mode are read-only.

Range:

  • true: read only

  • false: non-read-only

Table 60 LogExportPathResp

Parameter

Type

Description

obs_url

String

Definition: OBS path for storing training job logs, for example, obs://example/path.

Range: N/A

host_path

String

Definition: Path of the host where training job logs are stored, for example, /example/path.

Range: N/A

Table 61 SchedulePolicyResp

Parameter

Type

Description

required_affinity

RequiredAffinityResp object

Definition: Affinity requirements of a training job.

priority

Integer

Definition: Priority of a training job.

Range: 0 to 3

preemptible

Boolean

Definition: Whether the resource can be preempted.

Range:

  • true: The resource can be preempted.

  • false: The resource cannot be preempted.

Table 62 RequiredAffinityResp

Parameter

Type

Description

affinity_type

String

Definition: Affinity scheduling policy.

Range:

  • cabinet: strong cabinet scheduling

  • hyperinstance: supernode affinity scheduling

job_level

String

Definition: Overall network topology constraint of a job. This parameter is only valid when affinity_type is set to networkTopology. The system schedules all tasks of the job to the node group at the level specified by job_level or lower.

When you deliver a training job to a supernode resource pool, if the overall network topology constraint of the job is not set, the system assigns the value cluster by default.

Range

  • cluster: resource pool

  • hyperinstanceGroup: supernode

affinity_group_size

Integer

Definition: Size of an affinity group.

Range: N/A

affinity_group_level

String

Definition: Network topology constraint of an affinity group. This parameter is only valid when affinity_type is set to networkTopology. The system schedules the affinity group consisting of affinity_group_size tasks to a node group whose level is not higher than affinity_group_level.

When you deliver a training job to the supernode resource pool, if the network topology constraints of the affinity group are not set, the system sets the value to hyperinstanceGroup by default.

Range

  • hyperinstance: supernode

  • slice: cabinet

Table 63 CustomMetrics

Parameter

Type

Description

exec

Exec object

Definition: Metrics are collected in CLI mode.

http_get

HttpGet object

Definition: Metrics are collected in HTTP mode.

Table 64 Exec

Parameter

Type

Description

command

Array of strings

Definition: Metrics are collected in CLI mode.

Table 65 HttpGet

Parameter

Type

Description

path

String

Definition: URL for obtaining metrics through HTTP.

Constraints: This parameter and the following port parameter must be specified or left blank at the same time.

Range: N/A

Default Value: N/A

port

Integer

Definition: Port for obtaining metrics through HTTP.

Constraints: Both the URL and the port must either be configured together or remain empty.

Range: N/A

Default Value: N/A

Table 66 OutputModelResp

Parameter

Type

Description

obs

ObsModelResp object

Definition: OBS output information stored by a custom training job.

Table 67 ObsModelResp

Parameter

Type

Description

obs_path

String

Definition: OBS path for storing custom training jobs, for example, obs://example/path.

Range: N/A

local_path

String

Definition: Path of the host where custom training jobs are stored, for example, /example/path.

Range: N/A

Table 68 AssetModelResp

Parameter

Type

Description

id

String

Definition: Model ID.

Range: N/A

name

String

Definition: Model name.

Range: N/A

code

String

Definition: model code.

Range: N/A

version

String

Definition: Model version.

Range: N/A

location

String

Definition: Model address.

Range: N/A

desc

String

Definition: Model description.

Range: N/A

series

String

Definition: Model brand.

Range: N/A

type

String

Definition: Model type.

Range: N/A

Table 69 JobEndpointsResp

Parameter

Type

Description

ssh

SSHResp object

Definition: SSH connection information.

jupyter_lab

JupyterLab object

Definition: JupyterLab connection information.

tensorboard

Tensorboard object

Definition: TensorBoard connection information.

mindstudio_insight

MindStudioInsight object

Definition: MindStudio Insight connection information.

Table 70 SSHResp

Parameter

Type

Description

key_pair_names

Array of strings

Definition: Name of the SSH key pair, which can be created and viewed on the Key Pair page of the Elastic Cloud Server (ECS) console.

Range: N/A

task_urls

Array of TaskUrls objects

Definition: SSH connection address.

Table 71 TaskUrls

Parameter

Type

Description

task

String

Definition: Task ID of a training job.

Range: N/A

url

String

Definition: SSH connection address of a training job.

Range: N/A

Table 72 JupyterLab

Parameter

Type

Description

url

String

Definition: JupyterLab address of a training job.

Range: N/A

token

String

Definition: JupyterLab token of a training job.

Range: N/A

Table 73 Tensorboard

Parameter

Type

Description

url

String

Definition: TensorBoard address of a training job.

Range: N/A

token

String

Definition: TensorBoard token of a training job.

Range: N/A

Table 74 MindStudioInsight

Parameter

Type

Description

url

String

Definition: MindStudio Insight address of a training job.

Range: N/A

token

String

Definition: MindStudio Insight token of a training job.

Range: N/A

Table 75 MasJobConfig

Parameter

Type

Description

ft_job_uuid

String

Definition: Fine-tuning job UUID, which can be obtained by calling the API for creating a fine-tuning job.

Constraints: N/A

Range: N/A

Default Value: N/A

ft_train_type

String

Definition: Training type of a fine-tuning job. The supported training types include pre-training, full fine-tuning, and LoRA fine-tuning.

Constraints: N/A

Range: SFT (full fine-tuning), PRETRAIN (pre-training), and LORA (LoRA fine-tuning)

Default Value: N/A

model_type

String

Definition: Type of the asset model selected for the training job. Supported model types include text generation and image understanding.

Constraints: N/A

Range: TextGeneration (text generation) and ImageUnderstanding (image understanding)

Default Value: N/A

train_output_path

String

Definition: Path for storing the checkpoints or final outputs generated during fine-tuning. This path is an OBS path and is configured by you during training job creation, for example, obs://yyy/test/.

Constraints: N/A

Range: N/A

Default Value: N/A

train_process

Double

Definition: progress of fine-tuning a training job.

Constraints: N/A

Range: N/A

Default Value: N/A

checkpoint_id

String

Definition: Breakpoint ID. When a training job is resumed from a checkpoint, this field records the unique identifier (UUID) of the checkpoint.

Constraints: N/A

Range: UUID.

Default Value: N/A

task_env

TaskEnv object

Definition: Fine-tuning job training parameters.

Constraints: N/A

checkpoint_config

CheckpointConf object

Definition: Breakpoint configuration.

Constraints: N/A

Table 76 TaskEnv

Parameter

Type

Description

envs

Array of EnvVar objects

Definition: Fine-tuning environment variable information.

Constraints: N/A

Table 77 EnvVar

Parameter

Type

Description

label

String

Definition: Tag.

Constraints: N/A

Range: N/A

Default Value: N/A

des

String

Definition: Description.

Constraints: N/A

Range: N/A

Default Value: N/A

env_name

String

Definition: Environment variable name.

Constraints: N/A

Range: N/A

Default Value: N/A

env_type

String

Definition: environment variable type.

Constraints: N/A

Range: N/A

Default Value: N/A

value

String

Definition: environment variable value.

Constraints: N/A

Range: N/A

Default Value: N/A

modifiable

Boolean

Definition: Specifies whether the value can be modified.

Constraints: N/A

Range

  • true: yes

  • false: no

Default Value: N/A

displayable

Boolean

Definition: Specifies whether to display.

Constraints: N/A

Range

  • true: displayed.

  • false: not displayed.

Default Value: N/A

used_steps

Array of strings

Definition: phase when the environment variable is used.

Constraints: N/A

Table 78 CheckpointConf

Parameter

Type

Description

checkpoint_id

String

Definition: breakpoint ID.

Range: UUID.

save_checkpoints_max

Integer

Definition: Specifies the number of steps to be saved for a training resumption task.

Range

  • 0: disabled.

  • 1: automatic and unlimited.

skipped_steps

Integer

Definition: Specifies whether to skip steps during resumable training. If steps are not skipped, training interruptions from hardware or network issues are fixed. If steps are skipped, some data after the checkpoint (set by users) is ignored to prevent poor data quality from causing the loss to not converge.

Range

  • 0: not skipped.

  • 1: skipped.

restore_training

Integer

Definition: Specifies whether to resume a training task.

Range

  • 0: No.

  • 1: Yes.

Example Requests

The following is an example of how to obtain training jobs. The number of obtained training jobs has been limited to 1, and the system will only query data for training jobs with names containing trainjob.

POST https://{endpoint}/v2/{project_id}/training-job-searches?limit=1

{
  "offset" : 0,
  "limit" : 1,
  "filters" : [ {
    "key" : "name",
    "operator" : "like",
    "value" : [ "trainjob" ]
  }, {
    "key" : "create_time",
    "operator" : "between",
    "value" : [ "", "" ]
  }, {
    "key" : "phase",
    "operator" : "in",
    "value" : [ "" ]
  }, {
    "key" : "algorithm_name",
    "operator" : "like",
    "value" : [ "" ]
  }, {
    "key" : "kind",
    "operator" : "in",
    "value" : [ ]
  }, {
    "key" : "user_id",
    "operator" : "in",
    "value" : [ "" ]
  }, {
    "key" : "runtime_type",
    "operator" : "in",
    "value" : [ "debug" ]
  } ]
}

Example Responses

Status code: 200

ok

{
  "total" : 5059,
  "count" : 1,
  "limit" : 1,
  "offset" : 0,
  "sort_by" : "create_time",
  "order" : "desc",
  "group_by" : "",
  "workspace_id" : "0",
  "ai_project" : "default-ai-project",
  "train_type" : "job",
  "items" : [ {
    "kind" : "job",
    "metadata" : {
      "id" : "3faf5c03-aaa1-4cbe-879d-24b05d997347",
      "name" : "trainjob--py14_mem06-byd-108",
      "description" : "",
      "create_time" : 1636447346315,
      "workspace_id" : "0",
      "user_name" : "ei_modelarts_q00357245_01"
    },
    "status" : {
      "phase" : "Abnormal",
      "secondary_phase" : "CreateFailed",
      "duration" : 0,
      "start_time" : 0,
      "node_count_metrics" : [ [ 1636447746000, 0 ], [ 1636447755000, 0 ], [ 1636447756000, 0 ] ],
      "tasks" : [ "worker-0" ]
    },
    "algorithm" : {
      "code_dir" : "obs://test-crq/economic_test/py_minist/",
      "boot_file" : "obs://test-crq/economic_test/py_minist/minist_common.py",
      "inputs" : [ {
        "name" : "data_url",
        "local_dir" : "/home/ma-user/modelarts/inputs/data_url_0",
        "remote" : {
          "obs" : {
            "obs_url" : "/test-crq/data/py_minist/"
          }
        }
      } ],
      "outputs" : [ {
        "name" : "train_url",
        "local_dir" : "/home/ma-user/modelarts/outputs/train_url_0",
        "remote" : {
          "obs" : {
            "obs_url" : "/test-crq/train_output/"
          }
        }
      } ],
      "engine" : {
        "engine_id" : "pytorch-cp36-1.4.0-v2",
        "engine_name" : "PyTorch",
        "engine_version" : "PyTorch-1.4.0-python3.6-v2"
      }
    },
    "spec" : {
      "resource" : {
        "policy" : "regular",
        "flavor_id" : "modelarts.vm.pnt1.large",
        "flavor_name" : "Computing GPU(Pnt1) instance",
        "node_count" : 1,
        "flavor_detail" : {
          "flavor_type" : "GPU",
          "billing" : {
            "code" : "modelarts.vm.gpu.pnt1",
            "unit_num" : 1
          },
          "flavor_info" : {
            "cpu" : {
              "arch" : "x86",
              "core_num" : 8
            },
            "gpu" : {
              "unit_num" : 1,
              "product_name" : "GP-Pnt1",
              "memory" : "8GB"
            },
            "memory" : {
              "size" : 64,
              "unit" : "GB"
            }
          }
        }
      }
    }
  } ]
}

Status Codes

Status Code

Description

200

ok

Error Codes

See Error Codes.