Help Center/ CodeArts TestPlan/ User Guide/ Viewing and Evaluating Test Quality/ Viewing the Test Quality Dashboard
Updated on 2026-08-11 GMT+08:00
View PDF
Share

Viewing the Test Quality Dashboard

CodeArts TestPlan provides dashboards with more than 10 quality metrics, such as the requirement coverage rate, requirement pass rate, case execution rate, and legacy DI, for evaluation of functions, performance, and reliability. You can clearly learn about the progress and risks of the overall test plan through the dashboard.

Project-Level Dashboard

The project dashboard displays statistics on the test case library and test plan. The items include the requirement coverage rate, number of bugs, test case pass rate, test case completion rate, and details of associated bugs.

Quality Report of the Test Case Library

Log in to the CodeArts homepage, search for your target project, and enter the project. In the navigation pane, choose Testing > Quality Report. The quality report page is displayed by default.

Report Item

Description

Requirement Coverage

Percentage of tested requirements in the selected sprint and module. This reflects function test coverage.

  • Not tested: No test case is associated with the requirement, or each associated test case is not complete.
  • Testing: Some test cases associated with the requirement are uncompleted.
  • Completed: All test cases associated with the requirement are completed.
  • Requirement coverage = Completed/Total
NOTE:

In Scrum projects, only statistics on the Feature and Story requirements are collected by default. To collect statistics on the Epic requirements, select epic.

Defects

Collects statistics on the total number of defects in the selected sprint and module. The statistics are grouped by defect severity. To monitor a bug, check its group. A closed bug will be grouped into Done.

To view or change bug status groups, choose Settings > Work Item > Common Statuses, and locate the Status Category column.

NOTE:

The number of unresolved bugs includes the following:

  • Number of bugs in the To do and Doing states in a Scrum project.
  • Number of bugs whose state is not Completed under a Kanban project.

Case Pass Rate

Pass rate of test cases in the selected sprint and module. The test case pass rate and bugs reflect the overall product quality. The statistics are grouped based on the test case result. The test cases that are not executed are included in the Not executed group.

Pass rate = Number of successful cases/Total number of cases. Pass rate of executed test cases is calculated based on data from the chosen sprint and module.

Pass rate of executed test cases = Number of successful cases/Total number of executed cases.

Key Data Dashboard

Collects statistics on the requirement coverage, total number of defects, case pass rate, and case completion rate associated with manual and API automation test cases in the selected sprint and module.

Click to the right of Manual Test or Auto API Test to view defect or test case details. You can filter items by name or ID, or click a name to open its details page.

Requirement Test

Collects statistics on associated requirements, including total number of associated cases, pass rate, execution rate, and total number of associated bugs. It also displays the corresponding requirement IDs. The requirements can be filtered by status.

Defects Test

Displays a list of associated defects. You can filter the list by defect name or ID. Click a defect name to view its details page.

When Test case library is selected, defect statistics are unavailable. To view defect statistics, switch to the corresponding test plan.

Quality Report of a Test Plan

On the Quality Report page, click the Test case Library drop-down list in the upper left corner and select a test plan. The quality report page of the selected test plan is displayed.

The quality report of a test plan is not filtered by sprint or module. In addition, it shows the test case completion rate and the risk description of the test plan. Other report items are the same as those of the quality report of the test case library.

Report Item

Description

Case Completion Rate

Number of completed test cases in the selected plan. This reflects the test progress. The statistics are grouped by case status.

Completion rate = Number of completed cases/Total number of cases

Risk

Risk of the test plan. You can evaluate the risk level of the test plan and add risk description.

Manual Test

Requirement coverage rate, total number of bugs, pass rate, and completion rate of manual test cases.

Auto API Test

Requirement coverage rate, total number of bugs, pass rate, and completion rate of automated API test cases.

Personal Dashboard

Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The page displays the personal dashboard. It contains statistics that are processed by the current login user, including:
  • Personal case completion rate, case pass rate, submitted bug status, submitted bug severity, bug statistics based on the test case library and test plan in the project
  • Personal test plans, test tasks, and submitted bugs based on the test case library and test plan in the project

Custom Test Reports

Create a custom test report in either of the following ways:

  • On the homepage
    1. Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The homepage is displayed.
    2. Click Create Report in the upper right corner, or click Add Report in the lower left corner.
    3. On the displayed Select Report Type page, select the type of the report to be created.

  • On the quality report page
    1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
    2. In the navigation pane, choose Testing > Quality Report.
    3. Select a test case library or test plan, select the report type (Custom Test Report, Custom Distribution Report, and Progress Test Reports), and click Add Report.
    4. On the displayed Select Report Type page, select the report type as required.