An investigation into the use of field methods in the design and evaluation of interactive systems

Abstract

This paper reports the results of an international web-based survey on the use of field studies in the design and evaluation of interactive systems, which was conducted between December 2006 and February 2007. The results suggest that the advantages and disadvantages of field methods are generally well understood, but guidance is needed in their application and use. Field studies were most frequently used for understanding context, and respondents preferred a more varied approach to method use rather than following a defined methodology such as Contextual Design. Observations were rated as the most effective technique overall, although interviews appeared to be more frequently used. Significant areas of further improvement for field methods were identified as improvements in data collection/analysis tools and improvements in adaptability of methods.