El contenido no se encuentra disponible en el idioma seleccionado. Estamos trabajando continuamente para agregar más idiomas. Gracias por su apoyo.
- What's New
- Function Overview
- Service Overview
- Getting Started
-
User Guide
- Working with CodeArts TestPlan
- Enabling CodeArts TestPlan
- Accessing CodeArts TestPlan Homepage
- Configuring a Test Plan
- Configuring a Test Version
-
Configuring a Test Case
- Generating a Test Case
- Creating a Test Case by Using Mind Map
- Creating a Manual Test Case
-
Creating an Automated API Test Case
- Using Automated API Test Cases
- Creating an Automated API Test Case Template
- Adding an API Test Script by Using a Custom URL Request
- Adding an API Script by Importing a Postman File
- Adding an API Script by cURL
- Adding an API Script by Keyword Library
- Adding Logic Control to an API Script
- Setting Test Case Parameters of an API Script
- Setting Environment Parameters of an API Script
- Importing an Automated API Test Case Dataset
-
Built-in Functions
- Binary Addition Function
- Binary Subtraction Function
- Binary Multiplication Operation
- Binary Division Operation
- Obtaining the Current Timestamp
- Obtaining a Specified Timestamp
- Converting a Date into a Timestamp
- Converting a Timestamp into a Date
- Timestamp Addition and Subtraction Operations
- Generating Base64 Encoding
- Generating SHA512 Encoding
- Generating SHA256 Encoding
- Generating an MD5 Hash Value
- Generating a Random Number in a Specified Range
- Generating a Random String of a Specified Length
- Generating a Random Decimal in a Specified Range
- Generating a UUID
- Obtaining an Array via Reverse Index
- Obtaining the Element Values of an Array via Reverse Index
- Converting Uppercase Letters into Lowercase Letters
- Converting Lowercase Letters into Uppercase Letters
- Concatenating Strings
- Cutting Strings
- Obtaining String Length
-
System Keywords
- Overview
- GetIAMToken
- MySQLQuery
- MySQLUpdate
- MySQLInsert
- MySQLDelete
- OpenGaussQuery
- OpenGaussUpdate
- OpenGaussInsert
- OpenGaussDelete
- PostgreSQLQuery
- PostgreSQLUpdate
- PostgreSQLInsert
- PostgreSQLDelete
- MongoDBQuery
- MongoDBInsert
- MongoDBUpdate
- MongoDBDelete
- RedisGet
- RedisSet
- OBSWrite
- OBSDelete
- OBSQuery
- KafkaProducer
- KafkaConsumer
- TCP
- UDP
- WSConnect
- WSRequest
- WSWriteOnly
- WSReadOnly
- WSDisConnect
- DubboClient
- Executing a Test Case
- Managing Test Cases
- Creating and Executing a Test Suite
- Viewing and Evaluating Test Quality
- Settings
- API Reference
- Best Practices
-
FAQs
- What Do I Do If No Test Case Exists in a Test Suite?
- What Can I Do If I Do Not Have the Operation Permission?
- Why Am I See a Message Indicating that an API Automation Test Suite Is Being Executed or Queuing?
- What Do I Do If a Test Suite Does Not Exist?
- Why Can't I Download the Document in a Manual Test Case?
- What Do I Do If No Test Case Exists In a Test Plan
- Why Can't I Add Work Items of the Task Type When a Test Plan Is Created or Updated?
- What Do I Do If Test Cases Cannot Be Associated with Work Items of the Task Type?
- What Do I Do If the Test Case Completion Rate in the Test Report Is Lower Than 100%?
- Why Is the Status of Test Cases in a Test Plan Inconsistent with That in a Test Case Library?
- How Are Variables Passed Between Steps in API Automation Cases?
- How Do I Set Checkpoints for Test Procedures in API Automation Cases?
- Videos
- General Reference
Copied.
Evaluating Test Quality
- Log in to the CodeArts homepage and search for and access the target project.
- In the navigation pane, choose Testing > Quality Assessment.
- Click Add in the upper left corner of the page. Enter a report name and a test conclusion, select a version and a plan, and click OK.
Overview
Click the report name. The Overview page of the test report is displayed by default. The Overview page displays the test data of the selected test plan.
Report Item |
Description |
---|---|
Requirement Coverage |
The requirement coverage rate reflects the test coverage of function points. The test coverage rate of all requirements associated with the selected plan is calculated. Requirement coverage rate = Number of completed requirements/Total number of requirements |
Total Legacy DI |
DI value calculated based on all known defects in this version. All defects are calculated based on their severity levels. The DI value of each defect is as follows: Trivial: 0.1 Minor: 1 Major: 3 Critical: 10 |
New DI |
DI value calculated based on the outstanding defects associated with the test plan. |
Case Execution Rate |
Statistics on the execution of test cases. Case execution rate = Number of test cases that are executed as planned and have execution results/Total number of test cases as planned |
Case Automation Rate |
Proportion of automated test cases. Case automation rate in the test plan = (Total number of test cases – Number of manual test cases)/Total number of test cases |
Valid Case Rate |
Proportion of executed test cases where defects are found to all executed test cases. Valid case rate = Number of executed test cases where defects are found/Number of executed test cases |
Requirement Pass Status |
A requirement is passed if the status of all test cases associated with the requirement is Successful. Requirement pass rate = Number of passed requirements/Total number of requirements |
Case Pass Rate |
The pass rate reflects product quality. The pass rate covers all test cases in selected plans. Another chart displays data by result. Pass rate = Number of successful cases/Total number of cases |
Defect Severity |
Displays the number of defects associated with the selected plan. |
Automation Rate |
Displays the proportion of automated test cases in a pie chart. Case automation rate in the test plan = (Total number of test cases – Number of manual test cases)/Total number of test cases |
Case Pass Rate by Type |
Displays the pass rate of test cases of different test types. |
Bugs by Module |
Displays the number of defects by module. |
Details
On the Details page, you can view the outstanding and completion status of requirements and defects in the test plan.
Enter a title or number in the search box to search for the corresponding requirement or defect.
Evaluating Risks
On the Risk Evaluation page, you can configure Quality Attribute Evaluation and Risk Analysis, or customize modules to enter related report information.
- Quality Attribute Evaluation
Select a test type on the top, click the text box area, enter evaluation information, and click Save.
- Evaluating Risks
You can evaluate risks based on the test progress. Click the text box, enter risk analysis information, and click Save.
- Custom information
Click Create Custom Information and add an information module.
You can click the module name to redefine the module title, enter the related description, and click
to save the modification. You can click
to delete the new module.
Click Upload Attachment to upload a local file to the customized module.
NOTE:
1. The size of a single file to be uploaded cannot exceed 10 MB.
2. A maximum of 15 attachments can be uploaded.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot