Arsign: toward a mobile based arabic sign language translator using lmc

Abstract

Communication connects people by allowing them to exchange messages, to express their feelings either verbally or non-verbally. To communicate with their surroundings, hearing impaired people or deaf use sign language. Unfortunately, practicing sign language is not common among society witch make barriers between peoples. In this work we propose a new system to convert Arabic sign language from gesture to written text. To do that we propose a system based on three main components: 1) The Leap motion controller as gesture recognition device to capture hand and finger movements. 2) A processing module to convert recognized gesture to alphabet using a comparison algorithm working on a predefined dataset of gesture. 3) A user interface to display the text or to convert it to speech through text to speech engine. The proposed system is implemented as a mobile application running into an android based device.