Sound and movement visualization in the AR-Jazz scenario

Abstract

This paper describes AR-Jazz, an augmented reality application designed to visualize sound and movements in live jazz performances. The augmented scenario is achieved within the program Max MSP Jitter, with an integrated inertial sensor and a microphone. As a display, a cinema screen is used. The application was first shown at the SedaJazz Festival 2007 in Valencia (Spain). In first place, a workshop was made in order the musicians to become familiar with the application. Secondly, a live performance was shown. The experience is described in this paper. © 2009 Springer.