HMouse: Head tracking driven virtual computer mouse

  • Fu Y
  • Huang T
  • 21


    Mendeley users who have this article in their library.
  • 33


    Citations of this article.


A novel head tracking driven camera mouse system, called “hMouse”, is developed for manipulating hand-free perceptual user interfaces. The system consists of a robust real-time head tracker, a head pose/motion estimator, and a virtual mouse control module. For the hMouse tracker, we propose a 2D detection/tracking complementary switch- ing strategy with an interactive loop. Based on the reliable tracking results, hMouse calculates the user’s head roll, tilt, yaw, scaling, horizontal, and vertical motion for further mouse control. Cursor position is navigated and fine tuned by calculating the relative position of tracking window in image space and the user’s head tilt or yaw rotation. After mouse cursor is navigated to the desired location, head roll rotation triggers virtual mouse button clicks. Experimen- tal results demonstrate that hMouse succeeds under the cir- cumstances of user jumping, extreme movement, large de- gree rotation, turning around, hand/object occlusion, part face out of camera shooting region, and multi-user occlu- sion. It provides alternative solutions for convenient de- vice control, which encourages the application of interac- tive computer games, machine guidance, robot control, and machine access for disabilities and elders.

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Yun Fu

  • Thomas S. Huang

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free