Detecting emotional state of a child in a conversational computer game

  • Yildirim S
  • Narayanan S
  • Potamianos A
  • 105


    Mendeley users who have this article in their library.
  • 46


    Citations of this article.


The automatic recognition of user's communicative style within a spoken dialog system framework, including the affective aspects, has received increased attention in the past few years. For dialog systems, it is important to know not only what was said but also how something was communicated, so that the system can engage the user in a richer and more natural interaction. This paper addresses the problem of automatically detecting "frustration", "politeness", and "neutral" attitudes from a child's speech communication cues, elicited in spontaneous dialog interactions with computer characters. Several information sources such as acoustic, lexical, and contextual features, as well as, their combinations are used for this purpose. The study is based on a Wizard-of-Oz dialog corpus of 103 children, 7-14 years of age, playing a voice activated computer game. Three-way classification experiments, as well as, pairwise classification between polite vs. others and frustrated vs. others were performed. Experimental results show that lexical information has more discriminative power than acoustic and contextual cues for detection of politeness, whereas context and acoustic features perform best for frustration detection. Furthermore, the fusion of acoustic, lexical and contextual information provided significantly better classification results. Results also showed that classification performance varies with age and gender. Specifically, for the "politeness" detection task, higher classification accuracy was achieved for females and 10-11 years-olds, compared to males and other age groups, respectively. © 2009 Elsevier Ltd.

Author-supplied keywords

  • Child-computer interaction
  • Children speech
  • Emotion recognition
  • Feature extraction
  • Natural emotions
  • Spoken dialog systems
  • Spontaneous speech

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Serdar Yildirim

  • Shrikanth Narayanan

  • Alexandros Potamianos

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free