On-line mouth shape recognition system

Abstract

There are a lot of images processing and analysis algorithms applied in the research, such as color extraction, advanced morphology, particle filter, particle analysis, and edge detection. The purpose of this paper is to show an on-line mouth shape recognition system that provides useful features for facial expression recognition [1], audio-visual speech recognition [2] and assistive communication system for the disabled [3]. A digital camera is used in this system to acquire continuous images by capturing the upper of the body and then extract the skin area exactly. After that mouth area is located for mouth shape processing to produce correct shape of mouth. The experiment results indicate high accuracy over 95% in the Lab and meet various lighting conditions and complicated backgrounds.