HCI Using Gestural Recognition for Symbol-Based Communication Methodologies

Abstract

Sign language in itself is the only tool of communication for the society which is not able to hear voices and speak words. Using sign language, they can express their emotions and thoughts and can convey what they want to say. But not everyone understands sign language, only the people who require it do. So people with such kinds of handicaps need a translator with them in order to convert their language to a common tongue and that is the main reason of sign language recognition becoming such a crucial task. Since sign language consists of different movements and positions of the hand, therefore, the accuracy of sign language depends on how accurately the machine could recognize the gesture. We are trying to develop such a system what we call translating HCI for sign language. In this system, the user has to place their hand in front of the webcam performing sign gestures and in real time, the system will read your hand gesture and will return the respective character/alphabet on the screen. Utilizing the proposed system normal people can understand sign language and can easily communicate with hearing-impaired people.