Cloud-Based Interactive Hands free E-Learning Environment for Students with Disabilities

Abstract

In this study, cloud based innovative methods are introduced that allow users with motor skills impairments to access the customized learning platforms. The complete methodology relies on the development of existing technology originally developed for the Gaming Industry; Microsoft Xbox Kinect Sensor. A novel learning platform is developed for teaching students with motor skills impairments and other types of disabilities to learn Quran Recitation. The platform is integrated with a modified Kinect that allows users to access the computer software without the use of a traditional keyboard and mouse. The Kinect then acts as the interface between the uses and software. The system is designed based on the two approaches; hand-free operations via head motion and voice recognition to control the selection of items in the learning platform. For voice recognition, a dataset has also been built for training and initial testing for supervised learning. Extensive tests have been performed that proved the success of the system. This novel methodology provides a research platform for those interested in enabling students with motor skill impairments and students with disabilities in general.