A Framework for Exploring Churches/Monuments/Museums of Byzantine Cultural Influence Exploiting Immersive Technologies in Real-Time Networked Environments

Abstract

The unique art that was developed in Byzantine times is widely accepted as a precursor to the Renaissance and is still evident in monuments either from or influenced by the Byzantium. Visiting such a site is a unique experience due to the lavishly painted interior for both tourists and scholars. Taking advantage of the emerging 5G technologies, cloud/fog computing, and Augmented/Mixed Reality mechanisms, a common smart device (e.g., smartphone, tablet) could be employed to give a better experience to the end-users. The proposed framework is intended to provide visitors with interpretative information regarding the visited monuments and their paintings. Under the framework introduced in this paper, camera input is uploaded to a cloud/fog computing infrastructure where appropriate algorithms and services provide monument and painting recognition and the mobile application retrieves and projects the related information. In addition, the designed immersive user interfaces assist visitors in contributing in cases of monuments and paintings for which no available information exists. This paper presents the state of the art in approaches for immersive experiences in Digital Culture, reviews the current image recognition approaches and their suitability for Byzantine paintings, proposes interaction techniques appropriately designed for observation and interaction of paintings, and discusses the overall framework architecture that is needed to support the described functionality while stressing the challenging issues of the above aspects thus paving the road for future work and providing guidelines for a test-bed implementation.