Android-based Indonesian sign language model using robot hand

Abstract

Sign language is one of the most effective ways to communicate with deaf people. However, not everyone is able to use sign language. Therefore, in this study, a sign language display system was created using a hand robot that was moved through an Android-based application on a smartphone to overcome this problem. The design and development of the system begin from the manufacture of hardware consisting of one hand robot with 11 servo motors as the actuators, the Arduino Mega 2560 microcontroller as the main controller and a Bluetooth module for wireless communication between hand robot and smartphone. Then software development is carried out on the hand robot controller and android based application on a smartphone. Furthermore, system testing is carried out by validating the results of the letters and numbers shown by hand robot with gestures in the Indonesian Language Signalling System Dictionary (SIBI). The results show that the hand robot has been able to display letters and numbers according to the instructions given by an Android-based application on a smartphone with an 80% accuracy rate.