Low cost virtual face performance capture using stereo web cameras

Abstract

A complete system for creating the performance of a virtual character is described. Stereo web-cameras perform marker based motion capture to obtain rigid head motion and non-rigid facial expression motion. Acquired 3D points are then mapped onto a 3D face model with a virtual muscle animation to create face expressions. Muscle inverse kinematics updates muscle contraction parameters based on marker motion to create the character's performance. Advantages of the system are reduced character creation time by using virtual muscles and a dynamic skin model, a novel way of applying markers to a face animation system, and its low cost hardware requirements, capable of running on standard hardware and making it suitable for interactive media in end-user environments. © Springer-Verlag Berlin Heidelberg 2007.