A Framework for Standardizing the Development of Serious Games with Real-Time Self-Adaptation Capabilities Using Digital Twins

Abstract

Serious games are an important tool for education and training that offers interactive and powerful experience. However, a significant challenge lays with adapting a game to meet the specific needs of each player in real-time. The present paper introduces a framework to guide the development of serious games using a phased approach. The framework introduces a level of standardization for the game elements, scenarios and data descriptions, mainly to support portability, interpretability and comprehension. This standardization is achieved through semantic annotation and it is utilized by digital twins to support self-adaptation. The proposed approach describes the game environment using ontologies and specific semantic structures, while it collects and semantically tags data during players’ interactions, including performance metrics, decision-making patterns and levels of engagement. This information is then used by a digital twin for automatically adjusting the game experience using a set of rules defined by a group of domain experts. The framework thus follows a hybrid approach, combing expert knowledge with automated adaptation actions being performed to ensure meaningful educational content delivery and flexible, real-time personalization. Real-time adaptation includes modifying the game’s level of difficulty, controlling the learning ability support and maintaining a suitable level of challenge for each player based on progress. The framework is demonstrated and evaluated using two real-word examples, the first targeting at supporting the education of children with syndromes that affect their learning abilities in close collaboration with speech therapists and the second being involved with training engineers in a poultry meat factory. Preliminary, small-scale experimentation indicated that this framework promotes personalized and dynamic user experience, with improved engagement through the adjustment of gaming elements in real-time to match each player’s unique profile, actions and achievements. Using a specially prepared questionnaire the framework was evaluated by domain experts that suggested high levels of usability and game adaptation. Comparison with similar approaches via a set of properties and features indicated the superiority of the proposed framework.