Development of a speech-driven embodied entrainment character system with a back-channel feedback

Abstract

We have already developed a speech-driven embodied entrainment CG character system called “InterActor” which generates communicative motions and actions such as nods for entrained interaction from speech rhythm based on only voice input. Conventional InterActor performed the entrained communicative body movements and actions based on speech input without an audio back-channel feedback. In this study, we develop an embodied character system with the back-channel feedback based on the embodied interaction model. Moreover, the effectiveness of the system is demonstrated by the sensory evaluation in the experiment.