Emotion Recognition using Convolutional Neural Network in Virtual Meeting Environment

Abstract

This study is done in order to propose an Emotion Recognition System that uses Convolutional Neural Network in a Virtual Meeting Environment to detect non-verbal feedback that emerge when communicating. This study starts with the training process of the CNN model with version 2.3.0 of tensorflow-gpu library, along with FER-2013 dataset, where only 80% of the data is used as the training set, and the other 20% is used as the test set. The model is trained for 430 epochs that results in 73.86% rate of accuracy with a loss of 1.42. In the classification process, a Haar-Cascade Classifier algorithm is used to detect faces within an image that has been inputted using OpenCV. Next the already developed model is used to predict the image that has been pre-processed. Based on the results shown, it can be concluded that the study has provided satisfactory results and is expected to help in understanding non-verbal input given when communicating and among other various things.