Context-Aware Holographic Communication Based on Semantic Knowledge Extraction

Abstract

Augmented, mixed and virtual reality are changing the way people interact and communicate. Five dimensional communications and services, integrating information from all human senses are expected to emerge, together with holographic communications (HC), providing a truly immersive experience. HC presents a lot of challenges in terms of data gathering and transmission, demanding Artificial Intelligence empowered communication technologies such as 5G. The goal of the paper is to present a model of a context-aware holographic architecture for real time communication based on semantic knowledge extraction. This architecture will require analyzing, combining and developing methods and algorithms for: 3D human body model acquisition; semantic knowledge extraction with deep neural networks to predict human behaviour; analysis of biometric modalities; context-aware optimization of network resource allocation for the purpose of creating a multi-party, from-capturing-to-rendering HC framework. We illustrate its practical deployment in a scenario that can open new opportunities in user experience and business model innovation.