Help Center/ CodeArts TestPlan/ User Guide/ Configuring a Test Plan
Updated on 2024-11-13 GMT+08:00

Configuring a Test Plan

A standard test process includes the test plan, test design, test execution, and test report.

  • In the test plan and test design stages, you should specify the test scope and objectives, formulate test strategy, prepare test tools and test environments, establish test models, design test cases, and develop automated testing scripts.
  • A test plan specifies the test time, scope, and objectives, and manages all test activities. The test plan can be specific to a version, sprint, or special project.

Creating a Test Plan

Only the Epic, Feature, and Story work items of a Scrum project and the default Requirement work items of a Kanban project can be added to a test plan as requirements.

  1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
  2. In the navigation pane, choose Testing > Testing Plan.
  3. Click Create Plan in the upper part of the page. The Create Test Plan page is displayed.
  4. Set Name, Version (optional), Processor, Plan Period, Associated Sprint (optional), and Description (optional), and click Next.

    Configuration Item

    Mandatory

    Description

    Name

    Yes

    Name of a test plan. Describe the test scenario or function.

    Enter 3 to 128 characters of letters, digits, spaces, and special characters (,-_/|*&`^~;:(){}=+,×...'!@#$%.\'[]<>?"—). Do not start with a space.

    Version

    No

    The version of the test plan.

    Enter 3 to 32 characters of digits, letters, hyphens (-), underscores (_), and periods (.).

    Processor

    Yes

    Select a member in the project as the processor of the test plan.

    Plan Period

    Yes

    Select the start date and end date of the test plan.

    Associated Sprint

    No

    Associate the test plan with a sprint of the project.

    Description

    No

    Brief description of a plan. The value contains a maximum of 1,000 bytes.

  5. Select the execution mode, add a requirement, and click Save to complete the test plan creation.

    • The execution mode selected here can be modified in the test plan later.
    • After an execution mode is selected, menus corresponding to the mode are generated on the test case and test execution pages for managing the cases and suites of Manual Test and Auto API Test. Preset statistics reports of the corresponding mode are displayed in the quality report.

Editing a Test Plan

In the test plan list, click the name of the test plan to be edited. The editing window is displayed on the right of the page.

  • On the Details tab page, you can edit the test plan (including the test plan name, description, execution mode, and basic information). After editing the test plan, click Save.
  • On the Requirements tab page, you can add or remove requirements within the current test plan scope. The operations are the same as those in Creating a Test Plan.
  • On the Test Cases tab page, you can view the test cases in the plan, and add test cases from the version to which the test plan belongs.
  • On the Operation History tab page, you can view the editing history of the test plan.

Designing a Test Plan

Designing a test plan consists of designing test cases, developing automated testing scripts, and preparing test data based on the test requirements specified in the plan.

  1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
  2. In the navigation pane, choose Testing > Testing Plan.
  3. Select a test plan to be designed from the list.

    • Move the cursor over Design to view the design progress of the test plan, including the number of test cases, total number of requirements, and number of covered requirements.

      When the number of test cases is greater than 0, the circle around Design changes from gray to blue, indicating that the test plan is under design.

    • Click Design to go to the Testing Case page.

  4. On the Manual Test tab page, click Import in the right area and select Adding Existing Cases from the drop-down list.

    If no test case has been created or you need to create a test case, click Create Case. For details, see Creating a Manual Test Case. The new test case is also added to the test case library.

  5. In the displayed dialog box, select a test case and click OK.
  6. Click the Auto API Test tab to add or create automated API test cases to the test plan.
  7. Click the test plan name in the upper left corner of the page to switch to another test plan or view the global test case library.

    The global test case library displays all test cases (including test cases that belong to or do not belong to the test plan) in the current version. You can maintain the global test case library as required.

Executing a Test Plan

  1. Return to the Testing Plan page and select the test plan to be executed from the list.

    • Move the cursor over Execute to view the execution progress of the test plan. Statistics include the test progress, number of executed test cases, pass rate, and completed bugs/total bugs.

      When the number of executed test cases is greater than 0, the circle around Execute changes from gray to blue, indicating that the test plan is under test.

    • Click Execute to go to the Testing Execution page.

  2. On the Manual Test tab page, click in the Operation column to execute a manual test suite of multiple test cases. If no test suite is available, create one by referring to Creating a Manual Test Suite.
  3. Click the Auto API Test tab to execute the automated API test suite. For details, see Executing an Automated API Test Suite.
  4. After you manually set the status of all test cases in the test plan to Completed, the status of the test plan is automatically updated to Completed.

    On the Testing Plan page, click Execute. The Testing Execution page is displayed. You can create a test suite to execute the cases in the test plan.

Managing and Measuring a Test Plan

  1. Log in to the CodeArts homepage, search for your target project, and click the project name to access the project.
  2. In the navigation pane, choose Testing > Testing Plan.
  3. Move the cursor over the test plan whose report you want to view, and click Report.

  4. View the quality report of the test plan.

    • The page displays the current requirement coverage, defects, case pass rate, and case completion rate of the test plan. You can analyze and record test risks on the page.
    • In the Manual Test and Auto API Test areas, statistics on the execution of test cases and the number of bugs are displayed by execution type.
    • To add more reports to the page, click Add Report in the lower left corner, or click Create Report in the upper right corner.
    • To switch to another test plan or view the quality report of the global test case library, click the test plan drop-down box in the upper left corner of the page and select the target plan.