Prototyping Context-aware Augmented Reality Applications for Smart Environments inside Virtual Reality

Abstract

Prototyping context-aware augmented reality applications is a difficult task that often requires programming skills and is then not available for everyone. We aim to simplify this process thanks to a new virtual reality authoring tool for the creation of augmented reality applications for smart environments that can adapt to an evolving context of use. To do so, this tool introduces two main novelties regarding previous work. First, it proposes a prototyping step in the digital twin of the target environment where the author can create multiple versions of the content (visual aspect, modality, layout, area of visibility, etc.) and defines for each of them which context of use is targeted thanks to a dedicated diegetic user interface. Second, it includes the possibility to create new context variables with a visual programming approach that can leverage the smart environment sensors and actuators. The created application can then be deployed on various augmented reality devices and can support dynamic adaptations. We illustrate this tool with the creation of an application for smart buildings that can fit the needs of its various occupants. Thanks to a user study, we also present some usability feedback of this tool to assess its relevance and to provide guidelines for the future of this field of research.