3D assisted 2D face recognition: Methodology

Abstract

We address the problem of pose and illumination invariance in face recognition and propose to use explicit 3D model and variants of existing algorithms for both pose [Fit01, MSCA04] and illumination normalization [ZS04] prior to applying 2D face recognition algorithm. However, contrary to prior work we will use person specific, rather than general 3D face models. The proposed solution is realistic as for many applications the additional cost of acquiring 3D face images during enrolment of the subjects is acceptable. 3D sensing is not required during normal operation of the face recognition system. The proposed methodology achieves illumination invariance by estimating the illumination sources using the 3D face model. By-product of this process is the recovery of the face skin albedo which can be used as a photometrically normalised face image. Standard face recognition techniques can then be applied to such illumination corrected images. © Springer-Verlag Berlin Heidelberg 2005.