Developing BacaBicara: An Indonesian lipreading system as an independent communication learning for the deaf and hard-of-hearing

Abstract

Deaf and hard-of-hearing people have limitations in communication, especially on aspects of language, intelligence, and social adjustment. To communicate, deaf people use sign language or lipreading. For normal people, it is very difficult to use sign language. They have to memorize many hand signs. Therefore, lipreading is a necessary for communication between normal and deaf people. In Indonesia, there is still few education media for deaf people to learn lipreading. To overcome this challenge, we develop a lipreading educational media to help deaf and hard-of-hearing to learn Bahasa Indonesia, called BacaBicara. User-Centered Design (UCD) is implemented to design the application and to analyze the constraints and conceptual models for the needs of users. This conceptual model uses the picture, lipreading video, text, and sign language to help the users understand the contents. The High fidelity prototype was implemented for evaluating usability testing. Based on the evaluation of the application, the results show that the prototype matches the usability goals and the user experience.