SoulSkipper: A Voice-Controlled Emotional Adaptive Game to Complement Therapy for Social Anxiety Disorder

Abstract

In this paper, we introduce SoulSkipper, a voice-controlled emotional adaptive game based on the use of Cognitive Behavioral Therapy (CBT) to complement therapy for social anxiety disorder (SAD). The game allows players to interact with non-player characters (NPCs) through voice input, which helps players identify negative thoughts and practice speech performance through 1) specific social scenarios, 2) emotional adaptation, and 3) real-time voice feedback. Through our initial evaluation, we find that the combination of game elements and voice interactions helps players improve their awareness of therapeutic skills associated with SAD and face social interactions in real-life scenarios more positively.