Immersive stereoscopic 3D system with hand tracking in depth sensor

Abstract

Recently, interest in immersive tele-conference is increasing. Conventional 2D images cannot provide a stereoscopic effect, but stereoscopic 3D (S3D) images can provide a more realistic image to people. Also, hand tracking technology is an interesting research area, in the field of human computer interaction. Hand tracking technology that tracks and recognizes human hand movements has made it possible to provide a new concept of natural user interface. A depth sensor such as Kinect provides color information and depth information at the same time. In this paper, we propose an immersive S3D system by generating stereoscopic images using depth image based rendering technology and applying 3D hand tracking and augmented reality technology.