Spatiotemporal Feature Descriptor for Micro-Expression Recognition Using Local Cube Binary Pattern

Abstract

Micro-expression recognition has been an active research area in recent years, it plays an important role in psychology and public security. Due to the aspects of short duration and subtle movement, it is challenging to extract spatiotemporal features of micro-expressions. The existing methods only extract features in the three-dimensional orthogonal plane and fail to make full use of that information. To solve this problem, we propose a new Local Cubes Binary Patterns (LCBP) method for micro-expression recognition. LCBP is cascaded by the motion information LCBP_{direction} , the amplitude information LCBP_{amplitudes} , and the spatial information LCBP_{3D} to obtain the spatiotemporal features. The advantage of LCBP is its ability to preserve the spatiotemporal information and the low feature dimension. Furthermore, to increase the discrimination of features in micro-expression sequences, we apply a differential calculation energy map to find regions of interest (ROI) for getting a weighted energy map. The final micro-expression feature acquired by fusing the LCBP features and the weighted energy map are classified through the Support Vector Machine (SVM). We evaluate the proposed method on four published micro-expression databases including SMIC, CASME, CASME2, SAMM. Experimental results demonstrate that our proposed method achieves promising performance for micro-expression recognition.