Help Center/ CodeArts TestPlan/ User Guide/ Viewing and Evaluating Test Quality/ Viewing Test Quality Dashboard
Updated on 2024-10-11 GMT+08:00
View PDF
Share

Viewing Test Quality Dashboard

CodeArts TestPlan provides dashboards with more than 10 quality metrics, such as the requirement coverage rate, requirement pass rate, case execution rate, and legacy DI, for evaluation of functions, performance, and reliability. You can clearly learn about the progress and risks of the overall test plan through the dashboard.

Project-Level Dashboard

The project dashboard displays the requirement coverage rate, number of bugs, test case pass rate, and test case completion rate corresponding to the test case library and test plan, as well as detailed information such as bugs associated with the test cases.

Quality Report of the Test Case Library

Log in to the CodeArts homepage and search for and access the target project. In the navigation pane, choose Testing > Quality Report. The Quality Report page is displayed by default.

Report Item

Description

Requirement Coverage

Percentage of tested requirements in the selected sprint and module. This reflects function test coverage.

  • Not tested: No test case is associated with the requirement, or each associated test case is not complete.
  • Testing: Some test cases associated with the requirement are uncompleted.
  • Completed: All test cases associated with the requirement are completed.
  • Requirement coverage = Completed/Total
NOTE:

In Scrum projects, only statistics on the Feature and Story requirements are collected by default. To collect statistics on the Epic requirements, select epic.

Bug

Collects statistics on the number of unresolved defects and the total number of defects in the selected sprint and module. The statistics are grouped by defect severity.

NOTE:

The number of unresolved bugs includes the following:

  • Number of bugs in the To do and Doing states in a Scrum project.

Case Pass Rate

Pass rate of test cases in the selected sprint and module. The test case pass rate and bugs reflect the overall product quality. The statistics are grouped based on the execution result. The test cases that are not executed are included in the Not executed group.

Case pass rate = Number of successful test cases/Total number of test cases

Manual Test

Collects statistics on the requirement coverage rate, total number of defects, case pass rate, and case completion rate associated with manual test cases in the selected sprint and module.

Auto API Test

Collects statistics on the requirement coverage rate, total number of defects, case pass rate, and case completion rate associated with automated API test cases in the selected sprint and module.

Defects

List of bugs associated with test cases in the selected sprint and module. Click in the upper right corner of the Manual Test or Auto API Test area to view the list. You can filter bugs by bug name and ID. You can also click a bug name to go to the bug details page.

Test Cases

List of test cases in the selected sprint and module. Click in the upper right corner of the Manual Test or Auto API Test area to view the list. You can filter test cases by test case name and ID, or click a test case name to go to the case details page.

Quality Report of a Test Plan

On the Quality Report page, click the Test case Library drop-down list in the upper left corner and select a test plan. The quality report page of the selected test plan is displayed.

The quality report of a test plan is not filtered by sprint or module. In addition, it shows the test case completion rate and the risk description of the test plan. Other report items are the same as those of the quality report of the test case library.

Report Item

Description

Case Completion Rate

Number of completed test cases in the selected plan. This reflects the test progress. The statistics are grouped by case status.

Completion rate = Number of completed cases/Total number of cases

Risk

Risk of the test plan. You can evaluate the risk level of the test plan and add risk description.

Manual Test

Requirement coverage rate, total number of bugs, and pass rate of manual test cases.

Auto API Test

Requirement coverage rate, total number of bugs, pass rate, and completion rate of automated API test cases.

Personal Dashboard

Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The CodeArts TestPlan page displays the personal dashboard. It contains statistics that are processed by the current login user, including:
  • Personal case completion rate, case pass rate, submitted bug status, submitted bug severity, bug statistics based on the test case library and test plan in the project
  • Personal test plans, test tasks, and submitted bugs based on the test case library and test plan in the project

Custom Test Reports

Create a custom test report in either of the following ways:

  • On the homepage
    1. Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The homepage is displayed.
    2. Click Create Report in the upper right corner, or click Add Report in the lower left corner.
    3. On the displayed Select Report Type page, select the type of the report to be created.

  • On the quality report page
    1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
    2. In the navigation pane, choose Testing > Quality Report.
    3. Select the test case library or a test plan, click in the lower left corner of the page, click Add Report, and select the type of the report to be created.