Pakistan sign language recognition and translation system using leap motion device

Abstract

The recent innovation in the technology and introduction of new gesture control based devices, like leap motion controller, have revolutionized computing. Technology that can track finger and hand gestures accurately at very low cost can reshape the gesture control industry. Leap motion controller, a little USB device, has an ability to obtain accurate description of the hand and figures pose that can be used for Recognition of Pakistan Sign Language. Sign Language is very crucial to facilitate deaf and mute children to communicate with the society. This paper proposes a gesture based recognition system for Pakistan Sign Language using leap motion device. Our proposed system compromises of two modules training module and communication module. In training module motion data received from leap motion controller is used to train the system for Pakistan Sign Language. Than in communication module motion data is acquired through leap motion controller and fed into correlation algorithm to detect and recognize the sign and then convert it into text form. The proposed system provides an efficient and cost effective solution to communication problem of deaf and mute children.