A Free-Viewpoint Video Renderer

Abstract

Free-viewpoint video allows interactive control of camera viewpoint in video playback. This paper describes a state-of-the-art technique to render free- viewpoint video on the GPU. The algorithm requires video streams from a set of fixed or dynamic real-world video cameras. Arbitrary viewpoints are synthesised from the video streams using a three-dimensional (3D) proxy for the world. The source code for the render system is made available as a resource to the computer graphics and computer vision community. This provides (i) the facility to simulate camera viewpoints from publically available multiple-view video datasets and (ii) a baseline technique for free-viewpoint video synthesis in the development of interac- tive 3D video and 3DTV applications.