Gesture-based interactions in video games with the leap motion controller

Abstract

This paper explores the Leap Motion controller as gesture-controlled input device for computer games. We integrate gesture-based interactions into two different game setups to explore the suitability of this input device for interactive entertainment with focus on usability, user engagement, and personal motion control sensitivity, and compare it with traditional keyboard controls. In a first user study with 15 participants we evaluate the experience with the Leap Motion controller in the two different game setups. We also investigate differences between gamers and non-gamers. The results indicate the potential in terms of user engagement and training efforts for short-time experiences. However, the study results also indicate usability issues. The experiences with gesture-based controls are rated as exhausting after about 20 min. While the suitability for traditional video games is thus described as limited, users see potential in gesture-based controls as training and rehabilitation tools.