Multimodal, touchless interaction in spatial augmented reality environments

Abstract

Spatial augmented reality environments are increasing in many domains. However, from a user-centred perspective we still do not know how to interact with them properly. Thus, there is a need for new interaction concepts. In this paper we discuss certain aspects which are special for the interaction in spatial augmented reality environments. We conclude that the most promising form of interaction will be multimodal and touchless. Additionally it should be taken into account that the user is interacting in a 3D space. Therefore different ways of interaction might be more appropriate for different spaces around the user instead of only one. We give a short review of advantages and disadvantages of touchless and multimodal input devices and then outline spatial aspects of perception and interaction in 3D space. © 2011 Springer-Verlag.