Smartphone-based content annotation for ground truth collection in affective computing

Abstract

This paper presents a real-time emotion-annotation tool using a personal mobile device. To this end, an application based on the Valence-Arousal model was developed, following two different approaches ("Two-step Sequential Annotation"and "One-step Matrix Annotation"). The application was tested through, an experiment where users performed annotations with each version of the app and then filled a feedback questionnaire. This questionnaire contained statements used to assess the usability and mental workload. A total of 16 (9 female) participants aged between 21 and 34 years old engaged in this experiment. Overall the results were quite encouraging in both versions, taking into account that this is still a work in progress. The "Single-step Matrix Annotation"was considered the preferred version.