3D Audio + Augmented Reality + AI Chatbots + IoT: An Immersive Conversational Cultural Guide

Abstract

Typical Augmented Reality (AR) cultural heritage (CH) guides adopt a visuo-centric approach, wherein visual virtual elements are superimposed onto the physical world. Recent research has investigated the use of Audio AR to evoke multisensory immersive experiences to visitors of CH sites adopting screen-free interfaces to ensure that user attention is not distracted from the physical exhibits. A parallel trend in the audience engagement programs of cultural institutions involves the employment of AI chatbots which are engaged in dialogues with visitors to provide meaningful responses to user questions. Herein, we present Exhibot, an intelligent audio guide system aiming at enhancing the user experience of CH site visitors. Exhibot represents the first-ever approach to combine Audio AR and chatbot technologies to enable natural visitor-exhibit interaction, while also leveraging IoT devices to contextualize the delivered information. The usability and utility of Exhibot has been tested in a case study in outdoors environment with the preliminary results indicating a very positive user experience.