Help Center> ModelArts> User Guide (Senior AI Engineers)> Model Management> Model Evaluation and Diagnosis> Managing Evaluation Job Versions
View PDF

Managing Evaluation Job Versions

You can create multiple job versions for an evaluation job to evaluate models based on different dimensions or metrics. You can view, compare, and analyze evaluation results.

Creating a Version

  1. Log in to the ModelArts management console and choose Model Management > Evaluation/Diagnosis from the left navigation pane.
  2. On the Evaluation/Diagnosis page, select the evaluation job for which you want to create a version and click the job name. The Version Manager page is displayed. Click Create Version in the upper right corner. The Create Version page is displayed.
  3. On the Create Version page, reset job and resource pool parameters.

    For details about how to set job parameters, see Creating a Model Evaluation Job. Table 2 describes the parameters.

    For details about how to set resource pool parameters, see Creating a Model Evaluation Job. Table 3 describes the parameters.

  4. After setting the parameters, click Submit. After the version is created, the system automatically runs the evaluation job. An evaluation result is generated after the evaluation job is successful. You can view the evaluation result of each evaluation metric on the evaluation result page under Version Manager.

Terminating a Job Version

  1. Log in to the ModelArts management console and choose Model Management > Evaluation/Diagnosis from the left navigation pane.
  2. On the Evaluation/Diagnosis page, the basic information about jobs is displayed by default. Select a desired evaluation job and click the job name to go to the Version Manager page.
  3. On the Version Manager page, click Terminate in the upper right corner to terminate the job version.

    Only job versions in the Creating or Queuing state can be terminated. For job versions in the Completed state, the Terminate button is unavailable.

    After a job version is terminated, it cannot be restarted. You can only create another job version.

Deleting a Job Version

If you do not need to view the evaluation result of a job version, you can delete the job version to release resources.

  1. Log in to the ModelArts management console and choose Model Management > Evaluation/Diagnosis from the left navigation pane.
  2. On the Evaluation/Diagnosis page, select the evaluation job for which you want to manage versions and click the job name. The Version Manager page is displayed. In the upper right corner, click Delete. In the dialog box that is displayed, confirm the information and click OK.

    After an evaluation job is deleted, the corresponding result display page will be deleted and cannot be restored. Exercise caution when performing this operation.