Multiple camera, multiple person tracking with pointing gesture recognition in immersive environments

Abstract

In this paper, we present a technique that allows multiple participants within a large-scale immersive, virtual environment to interact with it using pointing gestures. Multiple cameras observing the environment are used along with various computer vision techniques to obtain a 3-D reconstruction of each participant's finger position, allowing the participants to point at and interact with virtual objects. This use of the pointing gesture provides an intuitive method of interaction, and has many applications in the field of human computer interaction. No markers or special clothing are required to be worn. Furthermore, we show that the system is able to provide robust results in real time. © Springer-Verlag Berlin Heidelberg 2008.