Comparison of matching criteria for the interposition problem in Augmented Reality

Abstract

This article discusses the interposition problem in Augmented Reality - that is, the realistic and physically-consistent embedding of a 3D virtual object (3DVO) into a real scene. Our method deals with stereoscopic views of an unstructured and unknown real scene and avoids explicit 3D reconstruction. Instead, we consider a 3DVO as a set of vertices and rely on local stereo matching to decide whether each vertex should be visible or not. Here, we focus on the choice of an optimal matching criterion in the particular context of interposition in Augmented Reality. After a brief presentation of our innovative solution, we review classical matching spaces and criteria, and select the most appropriate for our task. We compare and interpret their performance against parameters such as noise level and matching window size and present preliminary results of interposition for real scenes.