Tools for Graphical User Interface Evaluation Using Playback

Abstract

Usability testing during software development poses several problems. One problem is the high cost for conducting usability tests. Another is lack of objectivity in analysis of test results. To solve these problems, we developed a set of tools for detecting unexpected behavior of users in the recorded data of the user operations. These tools record mouse and keyboard operations and compare two operation sequences to detect the differences between them. When one sequences is performed by a possible user and the other sequences is performed by a skilled user or a designer, the detected differences are closely related to users' unexpected behaviors which should be noted by human observers during usability testing, evaluating graphical user interface designs. The tools' two main techniques are data gathering in playback mode and multi-step matching of recorded data. A preliminary experiment showed that the tools can automate part of the usability evaluation process by detecting differences often overlooked by human observers.