KeynVision: Exploring piano pedagogy in mixed reality

Abstract

Integrating new technology such as Augmented Reality into an established learning context is not a simple process. We explore the use of mixed reality for piano pedagogy, focusing on notation literacy, and playtest a series of prototypes with a panel of practitioners in piano teaching. Our piano training game prototypes called KeynVision (keen-vision) use the Microsoft Hololens to playfully introduce octave scales, chords, and arpeggios to beginners. Based on the results, the augmented contextualization of mixed reality can be an effective tool for aiding students in the process of learning to play piano.