Mobile camera-based user interaction

Abstract

We present an approach for facilitating user interaction on mobile devices, focusing on camera-enabled mobile phones. A user interacts with an application by moving their device. An on-board camera is used to capture incoming video and the scrolling direction and magnitude are estimated using a feature-based tracking algorithm. The direction is used as the scroll direction in the application, and the magnitude is used to set the zoom level. The camera is treated as a pointing device and zoom level control in applications, Our approach generates mouse events, so any application that is mouse-driven can make use of this technique. © Springer-Verlag Berlin Heidelberg 2005.