CHASE: Checklist to Assess User Experience in IoT Environments

Abstract

Internet of Things (IoT) can be seen as a variety of interconnected things (e.g., RFID tags, sensors, actuators, mobile phones) to provide a certain service to final users. The interaction between these things and the user in these environments is challenging due to interoperability, consistency of interactions, easy installation and so on. Then, there is a need to provide tools for the User Experience (UX) evaluation in IoT scenarios and, in this work, we propose CHASE, a checklist to facilitate UX evaluation in IoT scenarios. First, CHASE was constructed based on the results of a literature review that identified methods, instruments, and characteristics of human-Thing interaction and evaluation in these scenarios. Then, fourteen IoT experts reviewed a preliminary version of the checklist, followed by three Human-Computer Interaction (HCI) experts. Finally, three researchers used chase to evaluate the user experience in a real IoT environment to collect authentic feedback. This paper also presents a series of important points for the evaluation of UX in IoT environments based on the literature review, the opinion of the experts, and the IoT application evaluations.