MIKE: A multimodal cinematographic editor for virtual worlds

Abstract

We present an interface that allows creating camera scripts and storyboards for virtual scenes through a multimodal combination of speech and gestures. Users can specify shot positioning and cinematographic movement of several virtual cameras and create a rendered sequence of the scenario in real time. The interface provides a storyboard as a sequence of frames and scripts for each camera. In contrast to existing storyboard editors ours allows scripts to be specified concurrently with animation previews providing for live cuts. Preliminary evaluations show good promise and constitute an encouragement to explore synergies with smarter camera planning. © Springer-Verlag Berlin Heidelberg 2003.