1D Convolutional Autoencoder-Based PPG and GSR Signals for Real-Time Emotion Classification

26Citations
Citations of this article
35Readers
Mendeley users who have this article in their library.

This article is free to access.

Abstract

To apply emotion recognition and classification technology to the field of human-robot interaction, it is necessary to implement fast data processing and model weight reduction. This paper proposes a new photoplethysmogram (PPG) and galvanic skin response (GSR) signals-based labeling method using Asian multimodal data, a real-time emotion classification method, a 1d convolutional neural network autoencoder model, and a lightweight model obtained using knowledge distillation. In addition, the model performance was verified using the public DEAP dataset and the Asian multi-modal dataset 'MERTI-Apps'. For emotion classification, bio-signal data were window-sliced in 1-pulse units, and the label was reset to reflect the characteristics of the PPG and GSR signals. Simple data pre-processing, such as the prevention of loss and waveform duplication, was performed without using handcrafted features. The experiment showed that the accuracy of the proposed model using MERTI-Apps was 79.18% and 74.84% in the case of arousal and valence, respectively, for 3-class criteria, and the accuracy of the proposed model using DEAP was 81.33% and 80.25% in the case of arousal and valence, respectively, for 2-class criteria. The accuracy of the lightweight model was 77.87% and 73.49% in the case of arousal and valence, respectively, for 3-class criteria and its calculation time was reduced by more than 80% compared to the proposed 1d convolutional autoencoder model. We also confirmed that the proposed model improved computational time and accuracy compared to previous studies using MERTI-Apps and the lightweight model used in limited hardware environments enabled fast computation and real-time emotion classification.

References Powered by Scopus

A circumplex model of affect

11509Citations
N/AReaders
Get full text

Active appearance models

4254Citations
N/AReaders
Get full text

DEAP: A database for emotion analysis; Using physiological signals

3650Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Emotion recognition in EEG signals using deep learning methods: A review

80Citations
N/AReaders
Get full text

A Docker-based federated learning framework design and deployment for multi-modal data stream classification

8Citations
N/AReaders
Get full text

A Review of Intelligent Garment System for Bioelectric Monitoring during Long-Lasting Intensive Sports

6Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Kang, D. H., & Kim, D. H. (2022). 1D Convolutional Autoencoder-Based PPG and GSR Signals for Real-Time Emotion Classification. IEEE Access, 10, 91332–91345. https://doi.org/10.1109/ACCESS.2022.3201342

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 6

60%

Researcher 2

20%

Professor / Associate Prof. 1

10%

Lecturer / Post doc 1

10%

Readers' Discipline

Tooltip

Engineering 10

77%

Computer Science 2

15%

Social Sciences 1

8%

Save time finding and organizing research with Mendeley

Sign up for free