Gesture-based Interaction for AR Systems: A Short Review

Abstract

Gesture-based interaction constitutes the prominent interaction modality for Augmented Reality (AR) systems. In this state-of-the-art review, we classify the recent literature on hand gesture-based AR interaction techniques, concerning the various domains where AR is gaining a foothold. Based on the conducted analysis, a taxonomy is introduced for the classification of the various reported techniques on the grounds of their application domain, the context of use, gestures recognition method, and types of gestures used. Furthermore, the discussed analysis reveals that context of use is a factor to take into account when determining the gestures that should be employed when developing an AR application. At the same time, there is a trade-off between touch-based and mid-air gestures, regarding their simplicity and user engagement entailed, which needs to be carefully considered. In all cases, it is of utmost importance that AR gesture-based systems are designed following a human-centered approach. The analysis conducted and reported in this paper aims to motivate the informed development and integration of hand gesture interaction of AR applications in various contexts and provide information on the different approaches that can be employed.