A novel head tracking driven camera mouse system, called “hMouse”, is developed for manipulating hand-free perceptual user interfaces. The system consists of a robust real-time head tracker, a head pose/motion estimator, and a virtual mouse control module. For the hMouse tracker, we propose a 2D detection/tracking complementary switch- ing strategy with an interactive loop. Based on the reliable tracking results, hMouse calculates the user’s head roll, tilt, yaw, scaling, horizontal, and vertical motion for further mouse control. Cursor position is navigated and fine tuned by calculating the relative position of tracking window in image space and the user’s head tilt or yaw rotation. After mouse cursor is navigated to the desired location, head roll rotation triggers virtual mouse button clicks. Experimen- tal results demonstrate that hMouse succeeds under the cir- cumstances of user jumping, extreme movement, large de- gree rotation, turning around, hand/object occlusion, part face out of camera shooting region, and multi-user occlu- sion. It provides alternative solutions for convenient de- vice control, which encourages the application of interac- tive computer games, machine guidance, robot control, and machine access for disabilities and elders.
Mendeley saves you time finding and organizing research
Choose a citation style from the tabs below