Affective computing: Using covariance descriptors for facial expression recognition

Abstract

Facial expression contains a rich variety of affective information. Facial Expression Recognition (FER) is an emerging field that has broad applications in the fields of human-computer interaction, psychological behaviour analysis and image understanding. However, FER presently is not fully realized due to the lack of an effective facial feature descriptor. This paper will examine the performance of a novel facial image descriptor referred to as Local Directional Covariance Matrices (LDCM). The descriptor will consist of fusing features, such as location, intensity, filter responses and incorporate local texture patterns. Tests were done on both posed and spontaneous facial expression datasets to evaluate the performance of the proposed model on real-world applications. Results demonstrate the effectiveness of the covariance feature descriptors compared to standard methods.