ARTIFICIAL INTELLIGENCE AS A LOW-COST SOLUTION for MUSEUM VISIT DIGITAL CONTENT ENRICHMENT: The CASE of the FOLKLORE MUSEUM of XANTHI

Abstract

The on-demand content enrichment of an exhibition center visit is an active applied research domain. This work focuses on the exploitation of mobile devices as an efficient medium to deliver information related to an exhibit or an area within the exhibition center by utilizing machine learning approaches. We present YPOPSEI, an integrated system that formulates the information retrieval task as an image recognition mechanism, enabling visitors to simply capture an entity of interest in order to acquire information similar to a tour-guidance experience via their personal mobile devices. This scheme not only minimizes the additional infrastructure requirements, but additionally enhances the versatility in cases of exhibits topology alterations while still providing high accuracy in terms of image content recognition. Two hybrid approaches are developed that set Convolutional Neural Networks (CNNs) and Bags of VisualWords (BOVWs) to operate in a synergistic and cooperative manner. They are evaluated under real-world conditions on a client-server Web architecture system that experimentally operates within the premises of the Folklore Museum of Xanthi, Greece.