Share via

Modify test cases within a test set

[This article is prerelease documentation and is subject to change.]

During or after creating a test set, you can edit the test cases by changing the wording of questions or modifying the expected responses, keywords, or capabilities as needed. You can select multiple test cases to edit them in bulk by selecting the checkboxes beside each test case.

Edit test cases within a test set

  1. Go to your agent's Evaluation page.

Screenshot showing how to select the Evaluation tab when tab selection is compressed due to screen size.

  1. Select the test set.

  2. In the test set, select the test case you want to edit.

    Screenshot showing the list of test cases.

  3. Change the wording of a question by editing the text in the Question field.

    Screenshot showing the question text field.

  4. Most test methods require expected answers, keywords, or capabilities for each test case. Add that information to each field. To learn more about configuring each test method, see Choose evaluation methods.

    Test method Measures Scoring Configurations
    General quality How good is test case's answer based on specific qualities Scored out of 100% None
    Compare meaning How well the meaning of the test case's answer matches the expected answer Scored out of 100% Pass score, expected answer
    Capability use Whether the test case used the expected resources Pass/fail Expected capabilities
    Keyword match Whether the test case used all or any of the expected keywords or phrases Pass/fail Expected keywords or phrases
    Text similarity How well the text of the test case's answer matches the expected answer Scored out of 100% Pass score, expected answer
    Exact match Whether the test case's answer matches the expected answer exactly Pass/fail Expected answer

  5. Select Apply to save changes to a test case.

  6. When you're finished with your changes to your test set, select Save to save your test set or Evaluate to run the test.

Add more test cases to a test set

While creating or editing a test set, you can add more test cases.

  1. In your agent's Evaluation page, select the test set.

  2. Generate or manually add more test cases.

    Screenshot showing the Generate 10 more questions and Add a case manually buttons on Review your test cases page.

  3. Select and edit any new test cases to add details.

  • Last updated on