ASL Recognition and Conversion to Speech

Abstract

The deaf & dumb (or the Mute community) find it a tedious task to converse with ordinary people through sign language. This stands as a hindrance in even the most basic of their activities. It affects their personal development, interpersonal relations and limits the contributions they could otherwise make to society. The prime motive of this project is to provide an easy to use platform for the hard of hearing people to express themselves despite the sign language barrier. We aim to achieve this motive through gesture recognition. Using gesture recognition, we compute the mathematical interpretation of human hand gestures to recognize the signs conveyed by American Sign Language. The system enables real-time hand gesture and speech recognition and provides an innovative and simpler mode of communication for the mute people.