Viewing Test Quality Dashboard

Updated on 2024-10-11 GMT+08:00

View PDF

CodeArts TestPlan provides dashboards with more than 10 quality metrics, such as the requirement coverage rate, requirement pass rate, case execution rate, and legacy DI, for evaluation of functions, performance, and reliability. You can clearly learn about the progress and risks of the overall test plan through the dashboard.

Project-Level Dashboard

The project dashboard displays the requirement coverage rate, number of bugs, test case pass rate, and test case completion rate corresponding to the test case library and test plan, as well as detailed information such as bugs associated with the test cases.

Quality Report of the Test Case Library

Log in to the CodeArts homepage and search for and access the target project. In the navigation pane, choose Testing > Quality Report. The Quality Report page is displayed by default.

Click to enlarge

Report Item	Description
Requirement Coverage	Percentage of tested requirements in the selected sprint and module. This reflects function test coverage. Not tested: No test case is associated with the requirement, or each associated test case is not complete. Testing: Some test cases associated with the requirement are uncompleted. Completed: All test cases associated with the requirement are completed. Requirement coverage = Completed/Total NOTE: In Scrum projects, only statistics on the Feature and Story requirements are collected by default. To collect statistics on the Epic requirements, select epic.
Bug	Collects statistics on the number of unresolved defects and the total number of defects in the selected sprint and module. The statistics are grouped by defect severity. NOTE: The number of unresolved bugs includes the following: Number of bugs in the To do and Doing states in a Scrum project.
Case Pass Rate	Pass rate of test cases in the selected sprint and module. The test case pass rate and bugs reflect the overall product quality. The statistics are grouped based on the execution result. The test cases that are not executed are included in the Not executed group. Case pass rate = Number of successful test cases/Total number of test cases
Manual Test	Collects statistics on the requirement coverage rate, total number of defects, case pass rate, and case completion rate associated with manual test cases in the selected sprint and module.
Auto API Test	Collects statistics on the requirement coverage rate, total number of defects, case pass rate, and case completion rate associated with automated API test cases in the selected sprint and module.
Defects	List of bugs associated with test cases in the selected sprint and module. Click in the upper right corner of the Manual Test or Auto API Test area to view the list. You can filter bugs by bug name and ID. You can also click a bug name to go to the bug details page.
Test Cases	List of test cases in the selected sprint and module. Click in the upper right corner of the Manual Test or Auto API Test area to view the list. You can filter test cases by test case name and ID, or click a test case name to go to the case details page.

Quality Report of a Test Plan

On the Quality Report page, click the Test case Library drop-down list in the upper left corner and select a test plan. The quality report page of the selected test plan is displayed.

Click to enlarge

The quality report of a test plan is not filtered by sprint or module. In addition, it shows the test case completion rate and the risk description of the test plan. Other report items are the same as those of the quality report of the test case library.

Report Item	Description
Case Completion Rate	Number of completed test cases in the selected plan. This reflects the test progress. The statistics are grouped by case status. Completion rate = Number of completed cases/Total number of cases
Risk	Risk of the test plan. You can evaluate the risk level of the test plan and add risk description.
Manual Test	Requirement coverage rate, total number of bugs, and pass rate of manual test cases.
Auto API Test	Requirement coverage rate, total number of bugs, pass rate, and completion rate of automated API test cases.

Personal Dashboard

Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The CodeArts TestPlan page displays the personal dashboard. It contains statistics that are processed by the current login user, including:

Personal case completion rate, case pass rate, submitted bug status, submitted bug severity, bug statistics based on the test case library and test plan in the project
Personal test plans, test tasks, and submitted bugs based on the test case library and test plan in the project

Click to enlarge

Custom Test Reports

Create a custom test report in either of the following ways:

On the homepage
1. Log in to the CodeArts homepage. On the top navigation bar, choose Services > TestPlan. The homepage is displayed.
2. Click Create Report in the upper right corner, or click Add Report in the lower left corner.
3. On the displayed Select Report Type page, select the type of the report to be created.
On the quality report page
1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
2. In the navigation pane, choose Testing > Quality Report.
3. Select the test case library or a test plan, click in the lower left corner of the page, click Add Report, and select the type of the report to be created.