On aligning sets of points reconstructed from uncalibrated affine cameras

Abstract

The reconstruction of rigid scenes from multiple images is a central topic in computer vision. Approaches merging partial 3D models in a hierarchical manner have proven the most effective to deal with large image sequences. One of the key building blocks of these hierarchical approaches is the alignment of two partial 3D models by computing a 3D transformation. This problem has been well-studied for the cases of 3D models obtained with calibrated or uncalibrated pinhole cameras. We tackle the problem of aligning 3D models - sets of 3D points obtained using uncalibrated affine cameras. This requires to estimate 3D affine transformations between the 3D models. We propose a factorization-based algorithm estimating simultaneously the aligning transformations and corrected points, exactly matching the estimated transformations, such that the reprojection error over all cameras is minimized. We experimentally compare our algorithm to other methods using simulated and real data. © Springer-Verlag Berlin Heidelberg 2005.