Analysis of human-machine interaction through facial expression and hand-gesture recognition

Abstract

This paper focuses on a review of recent work on facial expression and hand gesture recognitions. Facial expressions and hand gestures are used to express emotions without oral communication. The human brain has the ability to identify the emotions of persons using expressions or hand gestures within a fraction of a second. Research has been conducted on human-machine interactions (HMIs), and the expectation is that systems based on such HMI algorithms should respond similarly. Furthermore, when a person intends to express emotions orally, he or she automatically uses complementary facial expressions and hand gestures. Extant systems are designed to express these emotions through HMIs without oral communication. Other systems have added various combinations of hand gestures and facial expressions as videos or images. The meaning or emotions conveyed by particular hand gestures and expressions are predefined in these cases. Accordingly, the systems were trained and tested. Further, certain extant systems have separately defined the meanings of such hand gestures and facial expressions.