The cognitive processing of film and musical soundtracks

Abstract

Previous research has demonstrated that musical soundtracks can influence the interpretation, emotional impact, and remembering of film information. The intent here was to examine how music is encoded into the cognitive system and subsequently represented relative to its accompanying visual action. In Experiment 1, participants viewed a set of music/film clips that were either congruent or incongruent in their emotional affects. Selective attending was also systematically manipulated by instructing viewers to attend to and remember the music, film, or both in tandem. The results from tune recognition, film recall, and paired discrimination tasks collectively revealed that mood-congruent pairs lead to a joint encoding of music/film information as well as an integrated memory code. Incongruent pairs, on the other hand, result in an independent encoding in which a given dimension, music or film, is only remembered well if it was selectively attended to at the time of encoding. Experiment 2 extended these findings by showing that tunes from mood-congruent pairs are better recognized when cued by their original scenes, while those from incongruent pairs are better remembered in the absence of scene information. These findings both support and extend the "Congruence Associationist Model" (A. J. Cohen, 2001), which addresses those cognitive mechanisms involved in the processing of music/film information. Copyright 2004 Psychonomic Society, Inc.