It is known from psychology and neuroscience that multimodal integration of sensory information enhances the perception of stimuli that are corrupted in one or more modalities. A prominent example of this is that auditory perception of speech is enhanced when speech is bimodal, i.e. when it also has a visual modality. The function of the cortical network processing speech in auditory and visual cortices and in multimodal association areas, is modeled with a Multimodal Self-Organizing Network (MuSON), consisting of several Kohonen Self-Organizing Maps (SOM) with both feedforward and feedback connections. Simulations with heavily corrupted phonemes and uncorrupted letters as inputs to the MuSON demonstrate a strongly enhanced auditory perception. This is explained by feedback from the bimodal area into the auditory stream, as in cortical processing. © Springer-Verlag Berlin Heidelberg 2006.
CITATION STYLE
Papliński, A. P., & Gustafsson, L. (2006). Feedback in multimodal self-organizing networks enhances perception of corrupted stimuli. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4304 LNAI, pp. 19–28). Springer Verlag. https://doi.org/10.1007/11941439_6
Mendeley helps you to discover research relevant for your work.