Multisensory object perception in the primate brain

Abstract

Traditionally a large proportion of perceptual research has assumed a specialization of cortical regions for the processing of stimuli in a single sensory modality. However, perception in everyday life usually consists of inputs from multiple sensory channels. Recently the question of how the brain integrates multisensory information has become the focus of a growing number of neuroscientific investigations. This work has identified both multisensory integration regions and crossmodal influences in brain areas traditionally thought to be specific to one sensory modality. Furthermore, several factors have been identified that enhance integration such as spatio-temporal stimulus coincidence and semantic congruency. Written for academic researchers and graduate students, the present book aims at elucidating the mechanisms of multisensory integration of object-related information with a focus on the visual, auditory, and tactile sensory modalities. Evidence will be presented from studies in both human and nonhuman primates at different levels of analysis ranging from intracranial electrophysiological recordings to non-invasive electro- or magnetoencephalography, functional magnetic resonance imaging, behavioral approaches, and computational modeling. Seventeen chapters have been aggregated in four sections: underlying mechanisms, audio-visual integration, visuo-tactile integration, and plasticity. About the Editors: Marcus J. Naumer studied biology, philosophy, and psychology at the universities of Freiburg and Landau in Germany. He obtained his PhD from the Faculty of Psychology and Neuroscience, University of Maastricht, The Netherlands. Since 2005 he has headed the Crossmodal Neuroimaging Lab at the Institute of Medical Psychology, Goethe University, Frankfurt, Germany. He conducts basic and clinical research on human multisensory (auditory, visual, and haptic) object perception using functional magnetic resonance imaging and magnetoencephalography. Jochen Kaiser studied psychology at the universities of Mainz in Germany and Glasgow in Scotland. He obtained a PhD from Imperial College School of Medicine, University of London, UK, in 1998. In 2004 he was appointed Full Professor and Director of the Institute of Medical Psychology at Goethe University in Frankfurt am Main, Germany. He has conducted extensive research on auditory and audio-visual perception, short-term memory and cortical oscillations in humans, using magnetoencephalography and functional magnetic resonance imaging.