Real-time virtual lego brick manipulation based on hand gesture recognition

Abstract

Recently, with the development of interactive virtual reality technology, many devices have been created to serve the purpose of helping people interact with virtual objects accurately and meticulously. Leap Motion, one of the new devices developed recently, not only supports some basic gestures, but also provides enough information so that developers can define their own gestures. In this paper, we present a 3D simulation which is quite similar to real Lego products using VR technology and Leap Motion. Players can perform simple actions like assembling, changing color, rotating Lego bricks, and zooming in and out. They can also control GUI easily through hand gestures that are analyzed and processed inside the system.