Step 7: Managing Project Testing

Creating a Sprint Test Plan

After the requirements (stories) to be implemented in Sprint 4 are determined (that is, Step 1: Managing Project Plans is complete), a tester can write test cases when developing code.

1. Create a test plan.
   1. Go to the Phoenix Mall project and choose Testing > Testing Plan.
   2. Click Create and configure test plan information.
      1. Basic information: Configure the following information and click Next.

         Table 1 Basic information about a test plan

         Sub-Configuration Item	Suggestion
         Name	Enter Sprint 4.
         Processor	Select Billy.
         Plan Period	You are advised to use the same period as Sprint 4 created in Req.
         Associated Sprint	Select Sprint 4.

      2. Advanced configuration: Select Manual Test. Confirm that the requirements in the list are the same as those of Sprint 4 in Req, and then click Save and Use.
   3. Return to the Testing Plan page. You can find the newly created test plan Sprint 4 in the list. The status of the test plan is New.

2. Design test cases.
   1. In the test plan Sprint 4, click Design.
   2. Expand the Requirements on the left of the page and find the Story User can query network of all stores.

      Click and choose Create Test Case.

      Figure 1 Creating a test case
      
   3. Enter Store Network Query, edit Test Procedure and Expected Results by referring to Table 2, and click Save.

      Table 2 Test steps

      Steps	Expected Results
      Opening the homepage of Phoenix Mall	The page is displayed.
      Clicking the Store Network menu	The Store Network page is displayed. Province filtering is available on the page, and information about recommended stores is displayed at the bottom of the page.
      Selecting City A	The store information list of city A is displayed.

   4. Create test cases for the other two stories in the same way.
   5. Choose Navigation Testing > Testing Plan to return to the test plan list.

      In the list, the status of the test plan Sprint4 is Designing.

Executing a Test Plan

After developing story codes and deploying applications on the test environment (completing Step 6: Deploying an Application (CCE) or Step 6: Deploying an Application (ECS)), developers can set the story status to Resolved and set the story handler to the tester.

In this case, the test personnel can execute the test cases corresponding to the story.

This section uses the store network query function as an example to describe how to execute test cases and how to report bug when test case execution fails.

1. In the Phoenix Mall project, click Navigation Work > Sprint.

   In Sprint 4, find the story User can query network of all stores and change the story status to Testing.

2. Go to the Testing > Testing Case page and select Sprint 4 in the upper part of the page.
3. In the list, click the case Store Network Query, change the status to Testing, and click Save.
4. Click the Manual Test tab and click in the row where Store Network Query is located. The Execute window is displayed on the right.
5. Execute the steps one by one in the test environment.
   • If the operation is successful, go to 6 to continue the operation.
   • The execution fails. For example, when you perform step 2, the page fails to be redirected and 404 is displayed. The system switches to 7 to continue the operation.
     Figure 2 Page display failure
     

6. Return to the test case execution window and record the execution result.
   1. In the table, set Actual Result of all steps to Successful.
   2. In the upper part of the table, set the test case result to Successful.
   3. Select set the case status to Completed.
   4. Click Save in the upper right corner of the page.
   Figure 3 Successful test case execution
   

   The status of the test case automatically changes to Completed. Go to 13 to continue the operation.

7. Return to the test case execution window and record the execution result.
   1. In the table, set the actual result of step 1 to Successful.
   2. In the table, set the actual result of step 2 to Failed and enter the content Redirection failure. 404 is displayed on the page.
   3. In the upper part of the table, set the test case result to Failed.
   4. Click Save in the upper right corner of the page.
   Figure 4 Failed test case execution
   

8. Click in the upper right corner of the page and choose Create Defect. The Create work item page is displayed.
9. At the end of the text box in the lower left corner of the page, you can see the reproduction procedure for automatically set in the defect.

   Edit defect details by referring to Table 3 and click Save. The work item list page is displayed.

   Table 3 Defect Details Configuration

   Configuration Item	Suggestion
   Title	Enter Store Network 404.
   Assigned To	Select Chris.
   Sprint	Select Sprint 4.

10. In the work item list, find Bug Store Network 404. Click the name and click the Associated tab. You can find the test case Store Network Query by expanding Associate with Test Case.
11. You can click the ID of an associated case to go to the case details page.

    Click the Defect List tab. A defect record is displayed, that is, the defect created in 9.

12. After the development personnel fix the defect and verify the defect, set the case result by referring to 6 and set the corresponding defect status to Closed.
13. Execute other test cases.
14. When the status of all cases is Completed, choose Testing > Testing Plan to return to the test plan list where you can find the status of Sprint 4 of the test plan is Completed.

Track test plans.

• View a quality report.

  Through the quality report, the team can intuitively view the current progress of the test plan, including the requirement coverage rate, defects, case pass rate, and case completion rate.

  On the Testing > Testing Plan page, click Report in the card of Sprint 4 to view the quality report.

• Customize reports.

  In addition to built-in quality reports, teams can customize statistical reports as needed.

  The following describes how to customize a statistical report by taking test case execution statistics as an example.

  1. On the Quality Report page, click in the blank area in the lower part of the page and click Add Report. In the dialog box that is displayed, select Custom Report.
  2. Edit the report information by referring to Table 4 and click Save.

     Table 4 Report configuration

     Configuration Item	Suggestion
     Report Title	Enter Test Case Execution Statistics.
     Data Type	Select Test Cases.
     Analysis Dimension	Select Result.

  3. The Quality Report page is displayed, and you can find the new report at the bottom of the page.