Real-time context aware audio augmented reality

Abstract

The purpose of this paper is to present a method for real time augmented reality sound production from virtual sources, which are located in a real environment. In the performed experiments, we will initially emphasize on augmenting audio information, beyond the existing environmental sounds, using headphones. The main goal of the approach is to produce a virtual sound that has a natural result so that the user gets immersed and senses a context aware synthetic sound. The necessary data, such as spatial coordinates of source and listener, relative distance and relative velocity between them, room dimensions and potential obstacles between virtual source and listener are given as input to the proposed framework. Real time techniques are used for data processing. These techniques are fast and effective in order to achieve high performance requirements. The resulted sound gives the impression to the listener that the virtual source is part of the real environment. Any dynamic change of the parameters will have as a result the simultaneous real time change of the produced sound.