Towards word semantics from multi-modal acoustico-motor integration: Application of the bijama model to the setting of action-dependant phonetic representations

Abstract

This paper presents a computational self-organizing model of multi-modal information, inspired from cortical maps. It shows how the organization in a map can be influenced by the same process occurring in other maps. We illustrate this approach on a phonetic - motor association, that shows that the organization of words can integrate motor constraints, as observed in humans. © 2005 Springer-Verlag Berlin/Heidelberg.