Piecewise planar scene reconstruction and optimization for multi-view stereo

Abstract

This paper presents a multi-view stereo algorithm for piecewise planar scene reconstruction and optimization. Our segmentation-based reconstruction algorithm is iterative to minimize our defined energy function, consisting of reconstruction, refinement and optimization steps. The first step is a plane initialization to allow each segment to have a set of initial plane candidates. Then a plane refinement based on non-linear optimization improves the accuracy of the segment planes. Finally a plane optimization with a segment-adjacency graph leads to optimal segment planes, each of which is chosen among possible plane candidates by evaluating its relationship with adjacent planes in 3D. This algorithm yields better accuracy and performance, compared to the previous algorithms described in this paper. The results show our method is suitable for outdoor or aerial urban scene reconstruction, especially in wide baselines and images with textureless regions. © 2013 Springer-Verlag.