Construction of an intelligent room based on gesture recognition

Abstract

This paper proposes an intelligent room in which a person can operate home appliances naturally by gestures. Cameras with pan-tilt and zoom functions are set in the room, and the system is realized by using image information. Intention of operation and 3 D position of the operator are recognized by detecting his/her hand waving, and the cameras are zoomed and focused on the operator's waved hand and the skin color is registered. The hand and finger regions are extracted by using the color information and gestures with the hand and fingers are recognized. This method is robust for the change of skin color because color information is not necessary at the stage of detecting hand waving and the skin color at the moment is used. A target appliance is chosen by recognition of pointing direction by the hand and operations of the appliances such as switching on/off, turning up/down of volume and changing channels are realized by recognizing the number of fingers and the hand's motion.