Facial point localization using combination method under occlusion

Abstract

Under the occlusion of the face in an image, the existing discriminative or generative methods often fail to localize facial points because of the limitations of local facial point detectors and appearance modeling in the discriminative and generative methods, respectively. To solve this problem, we propose a new facial point localization method that combines the discriminative and generative methods. The proposed method consists of an initialization stage and optimization stage. The initialization stage detects the face, estimates the facial pose, and obtains the initial parameter set by locating the pose-specific mean shape on the detected face. The optimization stage obtains the facial points by updating the parameter set using the combined Hessian matrix and gradient vector of shape and appearance errors obtained from two methods. In experiments, the proposed method yields more accurate facial point localization under heavy occlusions and pose variations than the existing methods.