Lie Detection based on Facial Micro Expression, Body Language and Speech Analysis

Abstract

Facial micro expressions, body language and analysis of speech are powerful tools of lie detection. Facial micro expression is an involuntary reaction that is impossible to fake. Liars experience stress which manifests itself as body language cues and verbal cues. Facial micro expressions are detected and recognized based on Paul Ekman's research using Principal Component Analysis. The speech input of the subject is subjected to speech analysis and checked if it is consistent with the results of the facial micro expression detector. The speech input is further subjected to stress analysis. This paper also discusses the various body cues exhibited by a liar and proposes a method to identify a subject's body language using the SURF (Speeded Up Robust Features) approach to see if the subject exhibits the body language of a liar.