Mobile and web UI test result reports

By default, the mobile web report is displayed after a mobile test is run from devices, emulators, or workbench. A statistical report is generated if the test is generated from HCL OneTest™ UI only. The mobile web report gives details on each action recorded and played back including the think time, the response time and warning messages that help you to identify problems. The statistical report summarizes the health of the run, displays the data that is the most significant to the run, summarizes the resource monitoring performance and gives an average step response time graph.

Mobile and web UI report

General information on the test
The report starts with general information on the generated test as listed below:
  • Name of the test, the project where it is saved, the date and time when it was last generated.
  • The status of the test execution, whether it was a success or failure, with the number of warnings if any.
  • The maximum measured response time value with a dynamic link to switch to the step where the value applies.
  • The name of the application under test, and more details on the application.
  • The device used to generate the test.
  • The duration of test run.
Details on test elements
The report then gives details for the test elements, by summarizing each step of the executed step, as listed below:
  • Think time between actions.
  • Time spent from the beginning of the test execution to the start of an action.
  • Measured response time.
  • Information on the execution preference that is the maximum think time that is enabled in the test execution preferences.
  • Warnings on the response time calculation:
    • Indicates if no progress monitor was detected during the test run and the policy synchronization should be modified.
    • Indicates that the response time was not measured due to the synchronization policy. Response time is the time spent by the application to react to an end-user action..

Statistical report

Overall page
The report begins with a summary, as listed below:
Run summary
Summarizes the information on the test that was run: elapse time, run status, name of the executed test.
Mobile run test
Summarizes the health of the run and displays the data most significant to the run. This data includes the number of application AUT launched during the test execution, the total number of step attempted and completed, the percentage of completion, the number of steps that failed, if any, and the number of errors.
Step Performance
The report contains a line graph that shows the 10 highest average step response times for the run. The table that follows the graph provides the following information for each step:
  • The minimum request response time for that step in the run.
  • The average request response time for the run.
  • The maximum response time for that step in the run.
  • The standard deviation response time for the run.
  • The rate for attempts
  • The number of attempts.
Resources
The report displays charts for the following resources, which are monitored at the application level and device level:
  • CPU: Displays the usage of the processor by application under test and the mobile device.
  • Used Physical Memory: Displays the usage of the physical memory by application under test and the mobile device.
  • Battery: Displays the usage of battery by the mobile device.
  • Network Transmitted: Displays the amount of data transmitted out by the application under test and the mobile device.
  • Network Received: Displays the amount of data received by the application under test and the mobile device.
Feedback