Rhythmic Accuracy of 3D Spatial Interaction for Digital Music

Abstract

This paper describes and evaluates the use of 3D spatial in-air body movement interaction for human control of music software. This technique was implemented, prior to this work, in an input device prototype, MoveMIDI, which allows users to initiate rhythmic musical events by hitting zones of 3D geometry in a virtual environment using position-tracked motion controllers. This work evaluates MoveMIDI's spatial interaction strategy for music in a usability study measuring timing accuracy of participants performing rhythms using MoveMIDI in comparison to two other input devices. The study revealed spatial unsureness of participants using MoveMIDI due to visualization and haptic shortcomings. While results for the MoveMIDI prototype are not positive, points of improvement are revealed, and our methodology provides a novel comparison for input devices in the context of rhythmic performance accuracy.