An interactive augmented reality system based on LeapMotion and Metaio

Abstract

Because of the difficulty of 3D registration and interactivity in current augmented reality, this paper mainly provides an interactive augmented reality system method based on LeapMotion and Metaio. Firstly, we select the Metaio SDK to complete the augmented reality 3D registration, including target image setting, image recognition, 3D scene rendering, image tracking, etc. Then, we use the LeapMotion to implement the real-time interaction, especially hand movement recognition and gesture tracking. We select the Metaio in Unity3D to call the camera and to complete the recognition of the card illustration. We use the LeapMotion to finish the real-time collision with the scene interaction. Finally, we implement an interactive Smurf fairy tale augmented reality system using our method. Our system is running stable and reliable.