Understanding Abstraction in Deep CNN: An Application on Facial Emotion Recognition

Abstract

Facial Emotion Recognition (FER) is the automatic processing of human emotions by means of facial expression analysis[1]. The most common approach exploits 3D Face Descriptors (3D-FD)[2], which derive from depth maps[3] by using mathematical operators. In recent years, Convolutional Neural Networks (CNNs) have been successfully employed in a wide range of tasks including large-scale image classification systems and to overcome the hurdles in facial expression classification. Based on previous studies, the purpose of the present work is to analyze and compare the abstraction level of 3D face descriptors with abstraction in deep CNNs. Experimental results suggest that 3D face descriptors have an abstraction level comparable with the features extracted in the fourth layer of CNN, the layer of the network having the highest correlations with emotions.