Resonant dynamics of grounded cognition: Explanation of behavioral and neuroimaging data using the ART neural network

Abstract

Research on grounded cognition suggests that the processing of a word or concept reactivates the perceptual representations that are associated with the referent object. The objective of this work is to demonstrate how behavioral and functional neuroimaging data on grounded cognition can be understood as different manifestations of the same cortical circuit designed to achieve stable category learning, as proposed by the adaptive resonance theory (ART). We showed that the ART neural network provides a mechanistic explanation of why reaction times in behavioral studies depend on the expectation or attentional priming created by the word meaning (Richter and Zwaan, 2009). A mismatch between top-down expectation and bottom-up sensory data activates an orienting subsystem that slows execution of the current task. Furthermore, we simulated the data from functional neuroimaging studies of color knowledge retrieval that showed anterior shift (Chao and Martin, 1999; Thompson-Schill, 2003) and an overlap effect (Simmons et al., 2007; Hsu et al., 2011) in the left fusiform gyrus. We explain the anterior effect as a result of the partial activation of different components of the same ART circuit in the condition of passive viewing. Conversely, a demanding perceptual task requires activation of the whole ART circuit. This condition is reflected in the fMRI image as an overlap between cortical activation during perceptual and conceptual processing. We conclude that the ART neural network is able to explain how the brain grounds symbols in perception via perceptual simulation.