Hand Gesture Recognition to Speech Conversion in Regional Language

Abstract

-Generally deaf-dumb people use sign language for communication, but they find difficulty in communicating with others who don't understand sign language. Due to which communications between deaf-mute and a normal person have always been a challenging task. We propose to develop a device which can convert the hand gestures of a deaf-mute person into speech. This methodology provides a map for developing a Digital wireless glove which is fitted with Flex sensors and accelerometer. These sensors sense the gestures of a person in the form of bend of fingers and tilt of the hand fist. This system includes a voice playback IC to give the real time speech output in regional language as well as a LCD module to display the text. The text display being in English, the voice output of this device will be in regional language (here Marathi). So this device acts as a communicator as well as a translator providing more flexibility in communication.