Augmenting virtual characters for more natural interaction

Abstract

We describe extensions to VirtualHuman, a multimodal dialogue system. It uses an interactive game scenario to demonstrate real-time multi-party dialogue between two human users and three virtual characters. The focus is to make the interaction more natural, robust and flexible. Here, we address issues of speech recognition in noisy environments, resolution of spatial references, and enhancements in the character interactions.