A Multi-Model Framework for Grading of Human Emotion Using CNN and Computer Vision

Abstract

Emotion analysis is an area which is been widely used in the forensic crime detection domain, a mentoring device for depressed students, psychologically affected patient treatment. The current system helps only in identifying the emotions but not in identifying the level of emotions like whether the individual is truly happy/sad or pretending to be happy /sad. In this proposed work a novel methodology has been introduced. We have rebuilt the Traditional Local Binary Pattern (LBP) feature operator to image the expression and combine the abstract characteristics of facial expression learned from the neural network of deep convolution with the modified features of the texture of the LBP facial expression in the full connection layer. These extracted features have been subjected as input for CNN Alex Net to classify the level of emotions. The results obtained in this phase are used in the confusion matrix for analysis of grading of emotions like Grade-1, Grade-2, and Grade-3 obtained an accuracy of 87.58% in the comparative analysis.