Heuristic evaluation and usability testing: Case study

Abstract

The goal of this user centered design (UCD) study was to to identify usability issues on the Boǧaziçi University Industrial Engineering (BUIE) department website user interface (UI) and also to provide a re-design guideline for the website. In this context, the website was evalauted via using heuristic evaluation, remote usability testing, and post-test questionnaire methods. Every single screen of the BUIE website was evaluated, and design problems along with associated severity rankings were determined. Based on the heuristic evaluation findings, various task scenarios were created for the remote usability testing study. Four diffferent user groups were identified for the study: high school students, BUIE undergraduate students, BUIE Graduate students/academic staff, and other university students. The users were asked to perform tasks relavant to the group characteristics and expectations related to the website. Their performance were evaluated in terms of task completion success rate, number of clicks, and time spent till either accomplishment, failure, or quittance by a remote usability testing tool, Loop11. A post user testing questionnaire was also administered online where the user subjective rating data were collected for each task in terms of ease of use. The results indicated numerous UI design issues, as confirmed by both heuristic and usability testing methods. Further redesign study is required to implement the results of this sudy in order to enhance the ease of use of the BUIE department website. © 2011 Springer-Verlag Berlin Heidelberg.