Transfer learning approaches in deep learning for Indian sign language classification

Abstract

Speech is the major way of human communication, but when it is limited, humans move to tactile kinaesthetic communication. People with speech-hearing impairments use sign language as an example of such adaptations. The deaf community uses Indian sign language (ISL) throughout India. In India, 250 licensed sign language interpreters are serving a deaf population of 1.8 to 7 million individuals. ISL interpreters are badly needed at institutes and places where persons with hearing impairments communicate. An Indian sign language picture database for English alphabets is established in this project. To prepare it for training, several pre-processing techniques were used. The effectiveness of deep learning neural networks is frequently influenced by the quantity of data available. As a result, data augmentation, a strategy for adding more and diverse samples to train datasets, was used to boost the effectiveness and outcomes of machine learning models. Our model is trained in CNN models utilizing transfer learning methodologies, with an accuracy of 95% for vgg16 and an accuracy of 92% for the inception model. More study on this research, as well as real-time implementation, has the potential to better connect people with hearing loss to society.