An Updated Systematic Mapping Study on Usability and User Experience Evaluation of Touchable Holographic Solutions

Abstract

This article presents an extended Systematic Mapping Study (SMS) focused on usability and user experience (UX) evaluation technologies for Touchable Holographic Solutions (THS). Given the growing integration of holograms in Augmented Reality (AR) and Mixed Reality (MR) settings, evaluating usability and UX becomes highly important. Our study expands on previous research by analyzing an additional two years of publications, covering 5429 studies, and selecting 65 that discuss 200 evaluation technologies. The main problem addressed is the gap in comprehensive evaluation frameworks that integrate usability and UX criteria. We followed systematic guidelines to identify and analyze evaluation technologies, highlighting an increased focus on UX alongside traditional usability. Key findings include the persistent emphasis on time efficiency in usability evaluations and the dominance of generic UX, usability, and pleasure/fun in UX assessments. However, unique aspects of MR, such as presence, are often overlooked. The study also reveals a preference for empirical validation through controlled experiments and case studies, although few technologies have undergone such validation. Head-mounted displays (HMDs) and smart glasses, especially Microsoft Hololens™, remain prevalent due to their advanced capabilities. Our findings underscore the need for integrated evaluation technologies and empirical validation to ensure reliability. This work contributes to the Human-Computer Interaction (HCI) area by mapping current evaluation technologies, identifying research gaps, and providing a foundation for developing innovative and effective evaluation methods for THS, thus advancing the understanding and improvement of user interaction in immersive environments.