Abstract
We present a system which consists of a lifelike agent animated in real-time using video and audio analysis from the user. This kind of system could be used for Instant Messaging where an avatar controlled like a puppet is displayed instead of the webcam flow. The overall system is made of video analysis based on Active Appearance Models and audio analysis based on Hidden Markov Model. The parameters from these two modules are sent to a control system driving the animation engine. The video analysis extracts the head orientation and the audio analysis provides the phonetic string used to move the lips. © Springer-Verlag Berlin Heidelberg 2007.
Cite
CITATION STYLE
Le Gallou, S., Breton, G., Séguier, R., & Garcia, C. (2007). Avatar puppetry using real-time audio and video analysis. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4722 LNCS, pp. 391–392). Springer Verlag. https://doi.org/10.1007/978-3-540-74997-4_54
Register to see more suggestions
Mendeley helps you to discover research relevant for your work.
