Designing SignSpeak, an Arabic Sign Language Recognition System

Abstract

Deaf and hearing-impaired individuals who communicate using sign language face several communication difficulties. Because the vast majority of people do not know sign language, the need for a sign language translator is growing significantly, especially for Arabic sign language (ArSL). Today, technology plays a significant role in people’s lives. Leap Motion technology can be used to address the aforementioned issues and improve communication between Saudi Arabia’s deaf and hearing individuals. In this study, we investigated the possibility of using a Leap Motion system to provide continuous ArSL recognition for two-way communication to improve communication between deaf and hearing individuals in terms of speed and independence. The system translates ArSL into spoken words for hearing individuals and transcribes spoken Arabic language into text for deaf individuals.