Support system using augmented reality display for use in teaching the guitar

Abstract

The complex and unfamiliar hand positions required to produce notes on the guitar mean that a beginner player usually finds learning to play a difficult process. We propose a system that makes use of augmented reality. The way to correctly hold the strings is shown by overlaying virtual hand models and lines onto a guitar via a display. By mirroring their hand movements with the image shown on a visual guidance, the player learns the correct hand positions. Accurate registration between the visual guidance and the guitar is a vital part of this system, so we need to track both the hand positions and the position of the guitar. We also propose a method of tracking the guitar by hybridizing a visual marker and the natural features of the guitar. Our tracking method enabled the system to continually display visual guides at the required position.