Design, Development, and Evaluation of a Metaverse-Integrated Mobile Application on Cell Biology for Deaf Learners

Abstract

This study investigates the development of the Johnnyverse mobile application to create an inclusive educational environment for Hearing Impaired students, focusing on complex scientific topics like cell biology. The application integrates metaverse technologies, including real-time speech-to-text and sign language translation, interactive 3D models, and Virtual Reality (VR) immersion. A user-centered approach guided the research, involving 30 Deaf students and 5 educators to ensure the app's features align with their educational needs. The study reveals that Deaf learners and educators highly value sign language customization, offline accessibility, interactive 3D models, and realtime translations. Key features include gamification, AIdriven adaptive lessons, and tools to foster collaboration among learners. The results showed strong usability, high engagement, and satisfaction, although some variability in system performance was noted. Teachers emphasized the importance of communication tools that support classroom participation and encourage peer learning. Future developments will focus on refining system performance, enhancing security, and expanding the app's content to support broader educational needs. The findings highlight the potential of using metaverse-based applications to enhance Deaf students' educational experiences, promoting inclusivity, engagement, and deeper understanding in science education.