Genetic Snakes: Application on Lipreading

Abstract

Contrary to Genetics Snakes, the current methods of mouth modeling are very sensitive to initialization (position of a snake or a deformable contour before convergence) and fall easily into local minima. We propose in this article to make converge two snakes in parallel via a genetic algorithm. The coding of the chromosome takes into account at the same time gradients and region type information contained in the image. In addition we introduce the use of STM (Sparse Template Matching) into the field of leapreading. Thanks to a temporal filter, word signatures (stored in Sparse Templates) make it possible to recognize various words pronounced several times at one week interval.