Posed and spontaneous expression recognition through restricted boltzmann machine

Abstract

This paper presents a new method to recognize posed and spontaneous expression through modeling their global spatial patterns in Restricted Boltzmann Machine (RBM). First, the displacements of facial feature points between apex and onset facial images are extracted as features, which capture spatial variations of facial points. Second, the point displacement related facial events are extracted from its displacements. Third, two RBM models are trained to capture spatial patterns embedded in posed and spontaneous expressions respectively. The recognition results on both USTC-NVIE and SPOS databases demonstrate the effectiveness of the proposed RBM approach in modeling complex spatial patterns embodied in posed and spontaneous expressions, and good performance on posed and spontaneous expression distinction.