Efficient fingertip tracking and mouse pointer control for a human mouse

Abstract

This paper discusses the design of a working system that visually recognizes hand gestures for the control of a window based user interface. We present a method for tracking the fingertip of the index finger using a single camera. Our method is based on CAMSHIFT algorithm and it tracks well particular hand poses used in the system in complex backgrounds. We describe how the location of the fingertip is mapped to a location on the monitor, and how it is both necessary and possible to smooth the path of the fingertip location using a physical model of a mouse pointer. Our method is able to track in real time, yet does not absorb a major share of computational resources. The performance of our system shows a great promise that we will be able to use this methodology to control computers in near future. © Springer-Verlag Berlin Heidelberg 2003.