Monitoring mental state during real life office work

Abstract

Monitoring an individual’s mental state using unobtrusively measured signals is regarded as an essential element in symbiotic human-machine systems. However, it is not straightforward to model the relation between mental state and such signals in real life, without resorting to (unnatural) emotion induction. We recorded heart rate, facial expression and computer activity of nineteen participants while working at the computer for ten days. In order to obtain ‘ground truth’ emotional state, participants indicated their current emotion using a valence-arousal affect grid every 15 min. We found associations between valence/arousal and the unobtrusively measured variables. There was some first success to predict subjective valence/arousal using personal classification models. Thus, real-life office emotions appear to vary enough, and can be reported well enough, to uncover relations with unobtrusively measured variables. This is required to be able to monitor individuals in real life more fine-grained than the frequency with which emotion is probed.