The modified block matching algorithm for a hand tracking of an HCI system

Abstract

A GUI (graphical user interface) has been a dominant platform for HCI (human computer interaction). A GUI-based interaction has made computers' simpler and easier to use. The GUI-based interaction, however, does not easily support the range of interaction necessary to meet users' needs that are natural, intuitive, and adaptive. In this paper, the modified BMA (block matching algorithm) is proposed to track a hand in a sequence of an image and to recognize it in each video frame in order to replace a mouse with a pointing device for a virtual reality. The HCI system with 30 frames per second is realized in this paper. The modified BMA is proposed to estimate a position of the hand and segmentation with an orientation of motion and a color distribution of the hand region for real-time processing. The experimental result shows that the modified BMA with the YCbCr (luminance Y, component blue, component red) color coordinate guarantees the real-time processing and the recognition rate. The hand tracking by the modified BMA can be applied to a virtual reality or a game or an HCI system for the disable. © Springer-Verlag Berlin Heidelberg 2003.