Human-Computer Interaction system based on nose tracking

Abstract

This paper presents a novel Human-Computer Interaction (HCI) system with calibrated mono-camera which integrates active computer vision technology and embedded speech command recognition technology. Mainly by tracking the nose tip motion robustly as the mouse trace, this system completes mouse mission with recognition rate more than 85% at the speed 15 frame per second. To achieve the goal, we adopt a novel approach based on the symmetry of the nose plane feature to localize and track invariantly to the varied environment. Comparing to other kinds of pointing device, this hand-free HCI system is hands-free, cheap, real-time, convenient and unpolluted, which can be used in the field of disabled aid, entertainment and remote control. © Springer-Verlag Berlin Heidelberg 2007.