Before you start creating Test Cases it is important to understand what type of Test Cases are required as well as the best practices for creating a successful set of Test Cases. Read through the prerequisites below and watch the tutorial video on Cyara Test Case Best Practices for more information.
You need the following information to create a Test Case:
- The pilot number of the IVR/PBX to be tested (this is the "Called Number" in your Test Case)
- The call flow of the IVR application
- The specific use cases/scenarios to be used for testing (IVR scripts)
- Dummy/test accounts for the purposes of conducting the tests
- The responses the IVR expects in each Step
- A telephone, in case you need to ring the system to confirm and validate the Steps while creating the Test Case
Best Practices for Creating Test Cases
Watch the video below for a series of Best Practice Principles when creating Test Cases.
Understanding Test Case Parameters
When using the Multi Pass Speech Recognition (or MPSR) method of Speech Quality assessment, Confidence parameters enable you to customise the success, satisfactory and failed thresholds for speech recognition when Cyara compares an IVR prompt to what a Test Case step expected to hear. This is the key to evaluating if there are issues with your IVR such as poor audio quality, missing or incorrectly defined prompts.
Cyara allows you to define the Major and Minor Confidence Thresholds of a test case step. The difference between the two becomes the satisfactory range. If the Major and Minor thresholds are the same, then there is no satisfactory range and the confidence result for that step can only be a success or failure.
Watch the video below for a walkthrough of the Major and Minor Confidence Thresholds that Cyara uses to determine if a Test Case run was successful.