Emotions logging in automated usability tests for mobile devices

Abstract

This work proposes the use of a system to perform emotions logging in automated usability tests for mobile devices. Our goal is to efficiently, easily and cost-effectively assess the users’ affective state by evaluating their expressive reactions during a mobile software usability evaluation process. These reactions are collected using the front camera on mobile devices. The analysis of three different emotions - happiness, surprise and anger – and two “emotional events” – spontaneous smile and gazing away from screen – performed through server software. This automated test generates a graphical log report, timing (a) current application page (b) user events e.g. tap (c) emotions levels e.g. level of happiness and finally (d) emotional events e.g. smiling or looking away from screen.