The development of an augmented virtuality for interactive face makeup system

Abstract

In this paper, we focus on developing an interactive face makeup system that allows the user to practice applying makeup on their face without using real makeup materials. In our system, feature points on the human face were tracked by Kinect and mapped to a 3D face model. Face textures were generated and mapped on the model by using UV mapping technique. The makeup tools were developed for providing tangible interactions to users. Users can perceive a realistic makeup feeling by using our makeup tools. When the user applies the makeup, the program will paint the color on a face model, which synchronized with the users’ movement in real-time. The system is evaluated by a subjective evaluation method. The result shows that our system can provide a new and attractive makeup experience to the users compared to other makeup applications.