Mobile and web UI test result reports

By default, the mobile web report is displayed after a mobile test is run from devices, simulators, emulators, or workbench. A statistical report is generated if the test is generated from HCL OneTest™ UI only. The mobile web report gives details on each action recorded and played back including the think time, the response time and warning messages that help you to identify problems. The statistical report summarizes the health of the run, displays the data that is the most significant to the run, summarizes the resource monitoring performance and gives an average step response time graph.

Mobile and web UI report

General information on the test
The report starts with general information on the generated test are:
  • Name of the test, the project where it is saved, the date and time when it was last generated.
  • The status of the test execution, whether it was a success or failure, with the number of warnings if any.
  • The maximum measured response time value with a dynamic link to switch to the step where the value applies.
  • The name of the application under test, and more details on the application.
  • The device used to generate the test.
  • The duration of test run.
Details on test elements
The report then gives details for the test elements, by summarizing each step of the executed step are:
  • Think time between actions.
  • Time spent from the beginning of the test execution to the start of an action.
  • Measured response time.
  • Information on the execution preference that is the maximum think time that is enabled in the test execution preferences.

Statistical report

Overall page
The following report begins with a summary:
Run summary
Summarizes the information on the test that was run: elapse time, run status, name of the executed test.
Mobile and Web UI test health
Summarizes the health of the run and displays the data most significant to the run. This data includes the number of application AUT launched during the test execution, the total number of step attempted and completed, the percentage of completion, the number of steps that failed, if any, and the number of errors.
Step Performance
The report contains a line graph that shows the 10 highest average step response times for the run. The table that follows the graph provides the following information for each step:
  • The minimum request response time for that step in the run.
  • The average request response time for the run.
  • The maximum response time for that step in the run.
  • The standard deviation response time for the run.
  • The rate for attempts.
  • The number of attempts.