A Systematic Review of Multimodal Interaction in Artificial Intelligent System Supporting Children to Learn Music

Abstract

Music, as an essential expression of art, has been fundamental to perceptual learning as well as emotional expression, which is particularly beneficial to children’s cognitive development and memory. Music has been a significant focus of research in the field of artificial intelligence (AI) along with arts. With the rapid development of AI technology comes a range of new interactive ways to assist children in learning music in the abstract. Although relevant research areas are exploring intelligent musical interaction systems for children, a systematic review of this field demonstrates that little empirical research has been conducted in this domain. Most research focuses on how technology can progress. Nevertheless, there is currently no focus on how AI technology can play a role in interactive systems from the perspective of children’s experiences and cognition. Therefore, this study systematically reviewed published research on intelligent music interaction systems for children by critically screening and evaluating a database of 315 research articles (n = 21). The current study’s review of the extant literature found that there is still a lack of focus on the relationship between intelligent interaction techniques and cognitive load during children’s music learning from a child’s cognitive perspective. The review revealed that intelligent music interaction systems for children are still in their infancy. The results of this study could be adopted by system developers and designers to create intelligent interactive music systems that are easier for children to understand and learn.