Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Abstract

The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.