Improving social skills in children with autism spectrum disorder using augmented reality and mixed reality technology combined with concept maps

Abstract

Autism Spectrum Disorder (ASD) involves difficulties in communication, expression, and social interaction, making it challenging for individuals to respond and engage effectively in various social contexts. This study used AR and MR (A/MR) technologies for social skills training in children with ASD. Previous applications of A/MR technology in teaching have lacked an explicit teaching framework and learning structure, resulting in confusion among learners and eventual abandonment of learning. To address these issues, the study combined concept mapping with A/MR technology to develop visualized and structured teaching materials and game strategies to aid children with autism in understanding and organizing abstract social concepts into a systematic mind map. Two game strategies, CMAR-ST and CMMR-ST, were implemented to enable children with autism to gradually strengthen and construct their cognition of social relationships and situations. Through situational guidance and in-game tasks, the children were empowered to make social judgments and exhibit appropriate reciprocal social responses when interacting with others. The present study recruited three high-functioning children with autism aged seven to nine as the research participants. A multiple-baseline across-subject design was employed for the teaching interventions. After three stages of experimentation, the results demonstrated that the teaching materials presented through CMAR-ST and CMMR-ST effectively enhanced the social concepts of children with autism. The game strategies helped the participants understand the relationships between different social information and cues, enabling them to effectively discern others' emotions, comprehend specific social gestures, and respond appropriately based on different social contexts with various individuals.