Enabling communications-based interactive storytelling through a tangible mapping approach

Abstract

We present a system supporting the re-use and re-purposing of captured video media for an interactive storytelling performance by a human storyteller. The system's components are based on a philosophy of non-verbal embodied interaction for both media capture and media re-use. The system uses nonverbal interaction sensors during media capture and an augmented reality tangible interface supporting spatial and motion communications affordances during storytelling. We discuss the requirements for an interactive storytelling tool - media retrieval, media re-purposing, and expressive media control - and show how our system design and implementation support these requirements for interactive storytelling. Interface evaluation shows that our system enables communication for storytelling, in particular non-verbal spatial communication. We conclude with a discussion of how our storytelling system is being further developed. © Springer-Verlag Berlin Heidelberg 2005.