Sound effects and the morphing façade: Emotion in sound of projection mapping

Abstract

Literature about projection mapping as a multimedia art form is scarce and, usually, it only addresses the visual effects or discusses the technology with which to achieve projection mapping itself. Writings about the role of sound design in projection mappings, as far as I could confirm through my academic research, are non-existent. Drawing on research in sound (music, sound effects, ambient, voice) for film, animation, and video game, in this paper I analyze how sound works in projection mapping, and the decisions I have made as a sound designer for the creation of soundtracks. This is a theoretical paper aims at providing an introduction to the literature of sound in projection mapping and to encourage further theoretical and empirical research to heighten its understanding. I will use three projection mappings: Bilbao, Tricenari Mas Guinardó and Voluntariat, for which I have worked as a sound designer and music composer as my case study, and will try to explain how the sound effects play a crucial role in eliciting emotions in projection mapping.