Evaluating a conversation-centered interactive drama

  • Mehta M
  • Dow S
  • Mateas M
 et al. 
  • 31


    Mendeley users who have this article in their library.
  • 20


    Citations of this article.


There is a growing interest in developing technologies for creating interactive dramas [13, 22]. Evaluating them, however, remains an open research problem. In this paper, we present a method for evaluating the technical and design approaches employed in a conversation-centered interactive drama. This method correlates players' subjective experience during conversational breakdowns, captured using retrospective protocols, with the corresponding AI processing in the input language understanding and dialog management subsystems. The methodology is employed to analyze conversation breakdowns in the interactive drama Fa{ç}ade. We find that the narrative cues offered by an interactive drama, coupled with believable character performance, can allow players to interpretively bridge system limitations and avoid experiencing a conversation breakdown. Further, we find that, contrary to standard practice for task-oriented conversation systems, using shallowly understood information as part of the system output hampers the player experience in an interactive drama.

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Manish Mehta

  • Steven Dow

  • Michael Mateas

  • Blair MacIntyre

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free