Facial expression classification: Specifying requirements for an automated system

Abstract

Automated facial expression classification arises as a difficult, yet crucial, pattern recognition problem in the design of human-computer interaction and multimedia interactive service systems. In the process of building NEU-FACES, a novel system of ours for processing multiple camera images of computer user faces to determine their affective state, we conducted and present here an empirical study in which we specify related design requirements, study statistically the expression recognition performance of humans, and identify quantitative facial features of high expression discrimination and classification power. © Springer-Verlag Berlin Heidelberg 2006.