Sentence Formation in NLP Engine on the Basis of Indian Sign Language using Hand Gestures

Abstract

A person who is hearing impaired or mute is not able to compete or work with a normal person because of lack of proper communication between the two. This paper presents the development of an application which will enable a hassle free communication between physically disabled person and normal person. The application is responsible for the conversion of hand gestures into a meaningful sentence which can be read out by a normal person. In this approach, gestures based on Indian sign language are used. The major steps associated with the application are gesture recognition and natural language processing as most important module in the paper proposed. The current work can be used as an interface to communicate with speech impaired and normal person. Thus, it will bridge the gap between speech impaired and normal people by capturing sign processing it recognizing it & presenting output as meaningful sentence.