3D Face Tracking Using Stereo Cameras: A Review

Abstract

This review considers previous research, regarding the background and applications of 3D face-tracking systems with a focus on stereo camera-based systems. Stereo cameras are less expensive than laser ranging systems, and they are widely available on devices such as smart phones. This review aims to spur further development and applications of face tracking in this domain. Many studies on face tracking have used concepts such as the Kanade-Lucas-Tomasi method, particle filters, tracking-learning-detecting, probability hypothesis density, mean shift/cam shift, and others. As imaging constraints are relaxed, facial tracking becomes more challenging. This review presents an exposition of the most common challenges in face tracking, such as occlusion and clutter, pose variations, changes in facial resolution, illumination variations, and facial deformation. Five forms of pose estimation are discussed: appearance template methods, detector arrays, flexible models, geometric methods, and tracking methods. Applications of the listed 3D face tracking systems are also discussed, including face modelling, film editing, access control, security, and surveillance.