Real Time Emotion Recognition with AD8232 ECG Sensor for Classwise Performance Evaluation of Machine Learning Methods

Abstract

Emotions are the accelerators of human intellect and innovation and creativity, so the ability to recognize emotions is in high demand. Real-time hardware has hurdles of Noise and hardware factors as compared to simulations. An electrocardiogram (ECG) sensor (AD8232), a temperature sensor (LM35), and a signal processing circuit is hardware of the proposed real-time emotion identification. The RR intervals are calculated from the ECG data. Emotions prediction using machine learning makes use of RR intervals and body temperature as features. One of the four emotions (namely 1. Happy 2. Stressed 3. Neutral 4. Sad.) is visualized at the serial port of the processor by using WESAD benchmark dataset and the HRV, serial, and pickle libraries.This article's innovation factors are (1) Use of ECG for emotion detection rather than disease detection with Emotion induction method, RR interval capturing and design of RR interval GUI for real time capture of temperature and ECG (2) Display of current emotion on Arduino serial port. (3) Measurement of Class performance using F1 score, macro average, and weighted average instead of general term accuracy. (4) Use of the probability based Navies Bayes as compared to traditional KNN, SVM, Random Forest nethods (5) Class wise performance for example Navies Bayes' specificity or accuracy is lower than SVM's (0.96), but its recall or sensitivity is higher (0.97) vs. (0.94) for stress.In this article, we presented performance parameters in terms of interactive computations, tabular form and graphical display.