Embodied emotion recognition system

Abstract

The relationships among body, brain, and environment have been important to recognize emotions according to the embodied emotion theory. Its relationships should be analyzed in real time because the relationships have been changed every moment. Therefore, this study has developed a system that automatically analyzes the complicated interactions based on personal data by path analysis in real time. The system has three phases: First, data have been collected with a wearable and smartphone device to measure photoplethysmogram (PPG), global positioning system (GPS) locations, and ambient noise. Second, features have been extracted by preprocessing. Finally, interactions have been determined by calculating the directed dependencies with path analysis. As a result, the relationships are presented in directed graphs form. This system is expected to be a useful platform to recognize and to predict human behavior based on the interactions among body response, brain response, and environment.