Analysis of similarity and differences in brain activities between perception and production of facial expressions using EEG data and the neucube spiking neural network architecture

Abstract

This paper is a feasibility study of using the NeuCube spiking neural network (SNN) architecture for modeling EEG brain data related to perceiving versus mimicking facial expressions. It is demonstrated that the proposed model can be used to study the similarity and differences between corresponding brain activities as complex spatio-temporal patterns. Two SNN models are created for each of the 7 basic emotions for a group of Japanese subjects, one when subjects are perceiving an emotional face and another, when the same subjects are mimicking this emotion. The evolved connectivity in the two models are then subtracted to study the differences. Analysis of the models trained on the collected EEG data shows greatest similarity in sadness, and least similarity in happiness and fear, where differences in the T6 EEG channel area were observed. The study, being based on the well-known mirror neuron concept in the brain, is the first to analyze and visualize similarity and differences as evolved spatio-temporal patterns in a brain-like SNN model.