Providing advanced touristic services by means of augmented reality and multimodal dialog

Abstract

In this paper, we describe a mobile application that combines Augmented Reality and Multimodal Dialog Systems to provide advanced touristic services. We have coupled machine vision solutions and sensors currently available in mobile devices to provide Augmented Reality functionalities. This integration facilitates these devices perceiving the surrounding world in similar ways as humans and providing context-aware information and services based on the location of the user. In addition, Multimodal Dialog Systems improve the access to these services by making them more accessible through a more intuitive, natural, and transparent human-machine interface. The paper also presents the results of a preliminary assessment of the developed App that shows the benefits of our proposal.