The following reports are part of the Cyara Web Portal.
Results Summary Report
- To view detailed results for a particular Campaign
Run, select Results Summary from the Report
Type drop-down list and click the button next to the desired
run. Detailed results are available for all reports. A sample Outbound Results
Summary report is as shown below:
The Results Summary Report displays all relevant details of the Campaign. A pie chart is displayed showing the number of Successful, Satisfactory, Failed, and Aborted calls.
- To view the results of a specific call, enter the call number in the Show call # field and click the Show button.
- Click Clear to disable the filter and display all calls.
- Results may also be filtered by specific Test Cases. To do this, select the Test Case from the Show Test Case drop-down list and click Show.
- Select from the Display drop-down list to display calls for a specific Test Case.
To obtain a further breakdown of satisfactory, failed, or aborted calls by the Step where they failed, hover the mouse pointer over the related segment of the pie chart. A second pie chart will be shown that provides a breakdown of the calls by detailed result description.
The Results Summary Report displays the Call, Test Case, Folder, Called Number, Time Placed, Duration, Result, Detailed Result, and Audio details. The Called Number is essentially the called/dialed number.
If you are a Reporting user with the Platform User role, you can use the Export All Details button into a .csv file for analysis. For Reporting users without the Platform User role, Export will generate a .csv file with information presented on the page.
If the selected Plan Type is Cruncher Lite, the Detailed Result and the Call Recording will not be available.

A filter is available to display All, Satisfactory, or Unsuccessful
calls. This is useful if you want to get to the root of a problem
immediately.
If you click the Unsuccessful button, it displays only the unsuccessful calls.
Results Summary Details Reporting
If you click on any segment of the pie chart (rather than hovering the mouse pointer over a segment), it drills down to a lower level – the Results Summary Details Reports. There are five drill-down detailed reports available:
- Failed Results Breakdown
- Satisfactory Results Breakdown
- Aborted Results Breakdown
- Internal Error Results Breakdown
- Successful Results Breakdown
These reports (as well as other reports) may also be accessed directly from the Other Reports drop-down list.
The Failed Results Breakdown Report is as shown below:
The Results Summary Details Report provides you with detailed information on the segment selected. In the above example, when you click the failed calls segment of the pie chart, the detailed report displays a pie chart of the different Test Cases that failed, the number of calls that failed, the Step at which they failed, and also a reason for the failure.
- You can also access this report from the Other Reports drop-down list by selecting Failed Results Breakdown.
- To obtain even more
detailed information about a call, click the
Detailed Result link. The
Detailed Result in the Result Summary Details
Report is as shown:
- This will display a screen
that shows the calls that failed. The Failed Results Breakdown is as shown
below:
- To view even more detail about a call, click the
button next to the call number. The Result Details screen
will display the individual call details as shown below:
The Result Details screen displays the results of the call and provides detailed information about each Step of the Test Case run.
Information includes:
- Step Number
- Description of Step
- Expect to Hear
- Reply With
- Response Time
- Duration of Step
- Min/Max Pause Time
- Minor/Major: The Minor and Major Threshold levels are displayed here for reference
- Min Confidence %/MOS
- PSST
- Detailed Result
- Result: This is based on the threshold levels set for the Step in the individual Test Cases. Results can be Failed, Successful, or Satisfactory
- Audio
Listening to Calls or Individual Steps
- To listen to whole call recordings, click the play button of the media player embedded applet.
- To listen only to
individual Steps, click the
button in the Step Recording column.
- To run the
Prompt Analyzer on the individual Step, click
the
button.
- Call Engine ID: This is the Call Engine Identifier, and it uniquely identifies the Cyara Platform Call Engine used to place the call. A user with Reporting and Platform User roles can use this to identify which Call Engine a failure occurred on to collect further information.
- Full Calling Party: This is the source address of a call. It is the address of the person or entity that made the call.
- Full Called Party: This is the destination address of a call. It is the address of the person or entity that received a call.
- Recording Path: This is the path where the recording is stored.
Test Case Step Transcription
Introduced in the Cyara 2020.2 release an additional option for Test Case Step Transcription is available. This feature allows you to transcribe any failed or satisfactory Test Case Step result, directly from the detailed results page of a Call. This enables users to quickly and easily compare the results of a Cyara Test Case to the configured Expect To Hear fields on Test cases, allowing for faster Test Case troubleshooting.
For Users that have the Test Case Step Transcription enabled in
their Cyara User Account, the Test Case Step results will display the following
icons, as you can see in this example below.

-
- Transcribe. Transcribes the current Test Case Step result using Cyara speech recognition.
-
- Listen. Plays the transcribed audio from this Test Case Step.
Results Summary Report for Web Test Cases
In the case of Web Campaigns, when you click the
Result Details for each Step, a screen as
shown below appears:
The details contain the Step number, Description, Expect, Reply, Response Time, Duration, Min/Max Pause Time, Minor/Major threshold, Detailed Result, Result, and Visual.
- To view the screenshots of Web recordings, click the View link that appears next to the Screenshots field. The Web carousel displays all the screens in a sequence unless the user interrupts.
- To pause on a screen, click the Pause button. The Web carousel pauses at that particular screen. To resume, click the Play button.
- Alternatively, to pause the screen, click anywhere on the screen that is playing.
- To view the full-sized
screen, click the
Enlarge
icon.
- To view a particular
screen, click the thumbnail that appears at the bottom of the recording. To
hide the thumbnail, click the
icon.
- To navigate through the
screen recordings, use the
and
icons.
- On the bottom of the carousel is the page indicator, which shows the number of the currently displayed image out of the total number of images. Also, there is a time indicator of the position relative to the overall test.
- To download the whole
recording, click the
Download
icon. The file is downloaded as an MP4 file.
- To stop the screen display and return to the Result Summary screen, click the Hide link in the right top corner of the screen.
- To view the Individual Step page result details, click the Test Case line at the bottom of the page.
In the case of failed Test Case, the following screen appears:
In the case of a failed Step, icons may appear next to the Failed
message. To view the related HTML and Javascript files and troubleshooting,
click the
icon.
To view the individual Step details, click the
icon.
Results Summary Report for Email Test Cases
An Email Test Case can be used for Pulse and Cruncher Campaigns. The Results Summary Reports are available for these Campaigns.
- To view detailed results for an Email Campaign Run,
select Cruncher from the Reports
drop-down list. A screen as shown below appears:
- Select the Plan Type as Cruncher and Channel as Email, then select the From Date and To Date fields.
- To view detailed results
for an Email Campaign Run, select
Results Summary from the
Report Type drop-down list and click the
Filter button. Detailed results are available
for all reports. A sample Email Cruncher Results Summary report is as shown
below:
The Results Summary Report displays all relevant details of the Campaign. A pie chart is displayed showing the number of Successful, Satisfactory, Failed, and Aborted sessions.
- To view the results of a specific session, enter the session number in the Show session # field and click the Show button.
- Click Clear to disable the filter and display all sessions.
- Results may also be filtered by specific Test Cases. To do this, select the Test Case from the Show Test Case drop-down list and click Show.
- Select from the Display drop-down list to display sessions for a specific Test Case.
To obtain a further breakdown of satisfactory, failed, or aborted sessions by the Step where they failed, hover the mouse pointer over the related segment of the pie chart. A second pie chart will be shown that provides a breakdown of the sessions by detailed result description.
The Results Summary Report displays the Concurrent Sessions, Session Made, Start Date, End Date, Duration, and Result.
- To view the Result Details
of a particular session, click the
link on the Session, and a screen as shown
below appears:
- The Result Details screen displays the results of the session. To view the Test Case, click the link against the Test Case field.
- The Result Details screen also provides information about the Customer Email and Reply Email details.
Results Summary Report for SMS Test Cases
A sample SMS Outbound Results Summary report is as shown below:
- To view the results of a specific session, enter the session number in the Show session # field and click the Show button.
- Click Clear to disable the filter and display all sessions.
- Results may also be filtered by specific Test Cases. To do this, select the Test Case from the Show Test Case drop-down list and click Show.
- Select from the Display drop-down list to display sessions for a specific Test Case.
To obtain a further breakdown of satisfactory, failed, or aborted sessions by the Step where they failed, hover the mouse pointer over the related segment of the pie chart. A second pie chart will be shown that provides a breakdown of the sessions by detailed result description.
The Results Summary Report displays the Concurrent Sessions, Session Made, Start Date, End Date, Duration, and Result.
- To view the Result Details of a particular session,
click the link on the Session, and a screen as shown
below appears:
- The Result Details screen displays the results of the session. To view the messages and logs, click the View link next to the Messages and Message Log fields.
- The Message displays the
SMS interaction in a new window as shown:
This view shows each message that was received offering the choice of seeing its actual received message, the expected message as dictated by the Test Case, and any difference between the two.
The Result Details screen also provides detailed information about each Step of the Test Case run. Information includes:
- Step Number
- Description of Step
- Expect
- Reply
- Mobile
- Response Time
- Min/Max Pause Time
- Minor/Major: The Minor and Major Threshold levels are displayed here for reference
- Detailed Result
- Result: This is based on the threshold levels set for the Step in the individual Test Cases. Results can be Failed, Successful, or Satisfactory.
Results Summary Report with a Cyara Service Step
A sample Results Summary report with a Cyara Service Step is as shown
below:
The Result Details screen provides detailed information about each Step of the Test Case run. The Service Step 2 and 3 information includes the following:
- Step Number
- Description of Step: The Cyara Service Step details are provided. The Cyara Service and the Test Case name is displayed.
- Cyara Service: Start Cyara Test Case or Wait for Cyara Test Case Results.
- Test Case: Name of the Test Case. Click the link and it will open a new tab to inspect the Test Case definition.
- Step Duration: How long it took to execute the current Step. The start of a Test Case is typically quick, while waiting for results will take several seconds.
- Service Run Duration: How long it took from starting a Test Case to getting its results. This information is available in the "Wait for Cyara Test Case Results" Steps.
- Report: Available for "Wait for Test Case Results" Steps. Click the link and it will open a new tab with the detailed results of the invoked Test Case.
- Output Parameters: A table of values received from the validated Test Case; for example, a PIN or a URL.
Endpoints Registration Log for Outbound Campaigns
The Endpoints Outbound Campaign report has an additional Registration Log tab, which provides the registration status of the Endpoints included in the Campaign. If the registration failed, the error response, including the SIP error code received from the SBC is displayed.

Comments
0 comments
Please sign in to leave a comment.