Hijaiyah Letters Sign Language Recognition for Deaf and Hearing Impaired Children Based on Principal Component Analysis Method

Abstract

Knowing and learning hijaiyah letters is a very important basis in reading Qur'an from an early age. For some normal people knowing and learning hijaiyah letters is relatively easy but unlike the children who have special needs like deaf and hearing impaired children. They can only communicate using sign language both in the form of hand gesture, body gesture, and facial expression. From these problems, the author the author is motivated to make a system for implementing the hijaiyah letters cues for deaf and hearing impaired children using PCA (Principal Component Analysis) method which was installed on desktop computer. The process of hand gesture recognition consists of several steps: camera initialization, preprocessing, feature extraction using PCA to find eigen value and eigen vector, and hand classification using euclidean distance. The output of hand gesture recognition is hijaiyah letters identification from alif to ya' in the form of text and sounds.