Evaluating Test Quality
Log in to the CodeArts homepage and search for and access the target project. In the navigation pane, choose Testing > Quality Assessment.
Click Add in the upper left corner of the page. Enter a report name and a test conclusion, select a version and a plan, and click OK.
Overview
Click the report name. The Overview page of the test report is displayed by default. The Overview page displays the test data of the selected test plan.
| Report Item | Description |
|---|---|
| Requirement Coverage | The requirement coverage rate reflects the test coverage of function points. The test coverage rate of all requirements associated with the selected plan is calculated. Requirement coverage rate = Number of completed requirements/Total number of requirements |
| Total Legacy DI | DI value calculated based on all known bugs in this version. NOTE: All bugs are calculated based on their severity levels. Each bug DI value corresponds to a severity level: 0.1: trivial; 1: minor; 3: major; 10: critical. |
| New DI | DI value calculated based on the known bugs associated with the test plan. |
| Case Execution Rate | Statistics on the execution of test cases. Case execution rate = Number of test cases that are executed as planned and have execution results/Total number of test cases as planned |
| Case Automation Rate | Proportion of non-manual test cases to all test cases. Case automation rate = (Total number of test cases in the test plan – Number of manual test cases in the test plan)/Total number of test cases in the test plan |
| Valid Case Rate | Proportion of executed test cases where bugs are found to all executed test cases. Valid case rate = Number of executed test cases where bugs are found/Number of executed test cases |
| Requirement Pass Status | A requirement is passed if the status of all test cases associated with the requirement is Successful. Requirement pass rate = Number of passed requirements/Total number of requirements |
| Case Pass Rate | The pass rate reflects product quality. The pass rate covers all test cases in selected plans. Another chart displays data by result. Pass rate = Number of successful cases/Total number of cases |
| Bug severity | Displays the number of bugs associated with the selected plan. |
| Automation Rate | Calculates the proportion of non-manual test cases to all test cases in the test plan. |
| Case Pass Rate by Type | Displays the pass rate of test cases of different test types. |
| Bugs by Module | The number of bugs is displayed by module. |
Details
On the Details page, you can view the outstanding and completion status of requirements and bugs in the test plan.
Enter a title or number in the search box to search for the corresponding requirement or bug.
Evaluating Risks
On the Risk Evaluation page, enter your evaluation of the test quality and risks, or add custom information modules to the report.
- Quality attribute evaluation
Select a test type on the top, click the text box area, enter evaluation information, and click Save.
- Risk analysis
Evaluate risks based on the test progress. Click the text box, enter risk analysis information, and click Save.
- Custom information
Click Create Custom Information and add an information module.
Click the module name to redefine the module title, enter the related description, and click the save icon to save the modification. To delete the module, click the deletion icon.
Click Upload Attachment to upload a local file to the custom module.
1. The size of a single file to be uploaded cannot exceed 10 MB.
2. A maximum of 15 attachments can be uploaded.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
