Optimized User Experience Design for Augmentative and Alternative Communication via Mobile Technology: Using Gamification to Enhance Access and Learning for Users with Severe Autism

Abstract

One of the most significant disabilities in autism spectrum disorder (ASD) includes a delay in, or total lack of, the development of spoken language. Approximately half of those on the autism spectrum are functionally non-verbal or minimally verbal and will not develop sufficient natural speech or writing to meet their daily communication needs. These individuals receive intervention in the area of augmentative and alternative communication (AAC) using mobile technologies. AAC services ideally should be provided starting at an early age but many young learners experience some degree of difficulty in gross and fine motor functioning that prevents accessing and benefitting from mobile AAC applications. A suite of evidence-based iPhone® applications, SPEAKall! Lite© and SPEAKplay!©, was developed to help learners with ASD (a) acquire initial speech and language skills, and (b) train critical gestures needed to fully access mobile touch screen devices. SPEAKplay! trains the performance of gestures including Directed and Sustained Touch, Drag and Drop, and Vertical and Horizontal Swipe through a gamification approach. Serious game design principles guided the creation of three arcade-style games including Pop the Bubbles, Fly the Rocket, and Feed the Dino. Initial usability testing with experienced AAC practitioners indicated SPEAKplay! to be a potentially viable intervention tool.