Placing arbitrary objects in a real scene using a color cube for pose estimation

Abstract

We describe an Augmented Reality system using the corners of a color cube for camera calibration. In the augmented image the cube is replaced by acomputer generated virtual object. The cube is localized in an image by the CSC color segmentation algorithm. The camera projection matrix is estimated with alinear method that is followed by a nonlinear refinement step. Because of possible missclassifications of the segmented color regions and the minimum number of point correspondences used for calibration, the estimated pose of the cube may be very erroneous for some frames; therefore we perform outlier detection and treatment for rendering the virtual object in an acceptable manner.