Wink Detection on the Eye Image as a Control Tool in Multimodal Interaction

Abstract

The selected problem of multimodal interaction for multimedia is discussed. The application for visual analysis of eye winking is presented. The proposed algorithm allows interpreting “eye gestures” as appropriate system events, which corresponds to executing system commands. The main aim of this paper is to develop replacing the usage of mouse keys by eye winking. Such a solution can work in multimodal interaction for many different applications. The work of surgeon in the operating room is a good example of situation, where busy hands do not allow controlling the computer system by traditional devices. Introduced interaction based on eye winking can help to communicate with system. The prototype has been built and set of experiments have been carried out in a group of 30 people. Tests have shown high acceptance of the proposed solution.