A New Practice Method Based on KNN Model to Improve User Experience for an AR Piano Learning System

Abstract

To improve the novices’ short-term piano learning performances, we presented an AR piano learning system with a new practice method proposed. Initially, an Android AR app was developed for the smart glasses Moverio BT-300. The system with the user-friendly graphical augmentations on the real piano and the multi-marker design reduces the cognitive load and supports faster learning of a novice without prior sight-reading skills. In addition, a new practice method with this AR system was studied, which not only considered the practice of a song at slower speed, but also included the repeated practice of some difficult measures selected by a k-Nearest Neighbor classifier. Finally, an evaluation was implemented to compare the new practice method with the normal practice, which treats all the measures in a song equally as important. And we found that this new practice method is more useful for novices to improve their performances during short-term learning.