Arabic sign language intelligent translator

Abstract

Arabic sign language (ArSL) is method of communication between deaf communities in Arab countries; therefore, the development of systemsthat can recognize the gestures provides a means for the Deaf to easily integrate into society. In this research we implemented a computational structurefor an intelligent interpreter that automatically recognizes the isolated dynamic gestures. The proposed system recognizes and translates gesturesperformed with one or both hands. It comprises five subsystems, building dataset, video processing, feature extraction, mapping between ArSL and Arabictext, and text generation. To apply the system, 100-signs of ArSL was used, which was applied on 1500 video files. It's were divided into five classes:alphabet, numbers, "prepositions, pronouns and question words", Arabic life expressions, and "nouns and verbs". The evaluation indicated that thesystem automatically recognizes and translates isolated dynamic ArSL gestures by highly accurate manner. The results showed that the system accuracy is 95.8%.