A mixed reality-based assembly verification and training platform

Abstract

Mixed reality (MR) based human-machine interaction provides a seamless interface between user and application environment, which synthesizes the advantages of the convenient interaction of virtual reality, and the strong realistic of augmented reality. In this paper, MR is applied in the context of industrial assembly process, and a MR based assembly verification and training platform is proposed. In the MR based assembly environment, virtual model, real images and augmented information are jointly displayed on the assembly scene, accessorizing multi-video display windows of different angles of view to browse the real assembly scene. Additionally, constraint proxies figuratively reconstruct part's constraint relationship in the MR environment, and avoid the complex calculation of constraint's match. By using a virtual hand with constraints guided to assemble, an effective and realistic assembly process experience is provided to the user. © 2009 Springer Berlin Heidelberg.