Point- and line-based parameterized image varieties for image-based rendering

Abstract

This paper generalizes the parameterized image variety approach to image-based rendering proposed in [5] so it can handle both points and lines in a unified setting. We show that the set of all images of a rigid set of m points and n lines observed by a weak perspective camera forms a six-dimensional variety embedded in ℝ2(m+n). Aparameterization of this variety by the image positions of three reference points is constructed via least squares techniques from point and line correspondences established across a sequence of images. It is used to synthesize new pictures without any explicit 3D model. Experiments with real image sequences are presented.