Sound selection by gestures

Abstract

This paper presents a prototypical tool for sound selection driven by users’ gestures. Sound selection by gestures is a particular case of ”query by content” in multimedia databases. Gesture-to-Sound matching is based on computing the similarity between both gesture and sound pa-rameters’ temporal evolution. The tool presents three algorithms for matching gesture query to sound target. The system leads to several applications in sound design, virtual instrument design and interactive installation.