Gesture aided voice for voiceless

Abstract

Language is used to express to our thoughts and to communicate with others. It is not limited to speech and sound. A sign language uses gestures which are a combination of hand movements and shapes, orientation, body movements and facial expressions instead of using sound. Sign language is the primary communication medium for the differently abled who have been given the title of “Divyang”. But the inability of common people to comprehend it poses as a problem for efficient communication between the specially abled and others. The idea is to solve the problem by building an wireless and efficient two way communication system to bridge the gap between sign and speech and also vice versa. The system makes use of gloves fitted with flex sensors along the fingers and wrists of both hands to record the bend and corresponding change in resistance while performing Indian Sign Language (ISL) gestures. Microcontroller would be used for mapping the voltage values and its corresponding identifier i.e. the word as it is fast and is effective in a real-time communication scenario. This is then sent to a mobile app using a Bluetooth module where the text is displayed and converted to speech which the normal person can understand. The proposed system would help the hearing and speech impaired community in their daily lives as well as to enhance their employability.