Model-based analysis and synthesis of time-varying mesh

Abstract

Time-varying mesh (TVM) is a technique that describes full shape and motion of a real-world moving object. Thus, TVM is used to capture and reproduce human behavior and natural movements precisely, such as the expression of the face or small changes in cloths. But on the other hand, TVM requires large storage space and computational cost. To solve this problem, we propose a framework of motion editing and synthesis. In our approach, a skeleton model is extracted from each frame and motion tracking and analysis are conducted using the skeleton models. Then, a representative frame is deformed based on the extracted motion information. As a result, 3D scene representation with much smaller data size is made possible. © 2008 Springer-Verlag.