CoHEARence of audible shapes—a qualitative user study for coherent visual audio design with resynthesized shapes

Abstract

One way to achieve an intuitive sound design are visual approaches for synthesis and sound collages. Therefore, during spectral synthesis and editing, the sound is designed in a visualization of the frequency domain. In order to create a coherent workflow between visuals and the resulting audio, the stimuli should be matched to each other. In this work, a qualitative user study is presented, which is supposed to show the intuitive understanding from the shape to the sound. The shape is hereby the spectral envelope. The general aim is to find out whether there is a connection between the visual shape and the subsequent auditory impression.