Photometric compensation to dynamic surfaces in a projector-camera system

Abstract

In this paper, a novel approach that allows color compensated projection on an arbitrary surface is presented. Assuming that the geometry of the surface is known, this method can be used in dynamic environments, where the surface color is not static. A simple calibration process is performed offline and only a single input image under reference illumination is sufficient for the estimation of the compensation. The system can recover the reflectance of the surface pixel-wise and provide an accurate photometric compensation to minimize the visibility of the projection surface. The color matching between the desired appearance of the projected image and the projection on the surface is performed in the device-independent color space CIE 1931 XYZ. The results of the evaluation confirm that this method provides a robust and accurate compensation even for surfaces with saturated colors and high spatial frequency patterns. This promising method can be the cornerstone of a real time projector-camera system for dynamic scenes.