Learning to assemble building blocks with a leap motion controller

Abstract

Playing toy blocks can greatly help children develop various abilities such as spatial, mathematical, creative problem solving etc. Developing a computer-aided block building system would benefit a lot in recreational and educational applications. Providing a natural user interface to increase the user’s sense of immersion is very important for the success of such kind system. In this paper, we develop a virtual toy block assembly system targeting on children’s preschool education. With the help of leap motion controller, child only need to make various hand gestures to play toy blocks similar to how they do in real scenario. A block snapping interface is designed to help quickly place block at the appropriate position. Our system demonstrate great potential in education area.