Team usability testing: development and validation of a groupware usability evaluation method

Abstract

As virtual teamwork became widespread, the importance of the usability of groupware has increased, as groupware must have high usability in order to properly support teamwork. Several studies have focused on the usability evaluation of groupware, yet, both in terms of science and practice, there is a lack of a method that, like existing empirical single-user methods, can be routinely applied in software development practice. The new Team Usability Testing method differs from previous methods in that it is an empirical method for evaluating synchronous (real-time) collaborative software that explores the team usability problems with the help of real or potential users. The method consists of questionnaires, screen recording videos and group interviews, and the framework of data processing is based on the theory of the mechanics of collaboration. In the four steps of the development of the method, empirical studies under laboratory conditions and real working conditions, and then, for validation purposes, analytical, heuristic evaluation with the involvement of usability experts were performed. During the development and the application of the method, the communication patterns of different teams were examined in terms of their relationship to software usability. In this paper we present the results of the second laboratory study and the heuristic evaluation in details. Overall, the method is able to explore team usability problems of different types of teams, making it a valuable element in existing methods for evaluating the usability of groupware.