3D recognition based on ordered images reconstruction

Abstract

Nowadays, more and more applications require precise and quickly 3D recognition, such as augmented reality and robot navigation. In recent years, model-based methods can get accurate object or scene recognition, but it takes a lot of time to reconstruct the model. Therefore, we propose a fast 3D reconstruction method based on ordered images for robust and accurate 3D recognition. The proposed algorithm consists of two parts, the offline processing stage, and the online processing stage. First, in the offline processing stage, the sparse point cloud model of the scene or object is reconstructed based on the sequential images, optimized using the BA algorithm based on the local correlation frame, and then the local descriptor of the resulting model points is stored. Secondly, in the online processing stage, for each image frame of the camera video, a matching relationship between the stored point cloud and the 2D feature points on the image frame is established, based on which the pose of the camera can be solved accurately.