Space and the Vision–Language Interface: A Model-Theoretic Approach

Abstract

The relation between spatial vision and spatial language has always been a source of controversy. Three problems can be identified as in need of a solution. A first problem pertains to the nature of the minimal information units that make up spatial vision and language. A second problem pertains to the ‘dynamic’ aspects of vision and language, or what visual information to and similar adpositions correspond to. A third problem pertains to how these different types of information are related one another, and what is the status of this ‘interface’, especially within a broader theory of language and cognition. The solution proposed here consists in a formal (model-theoretic) treatment of visual and linguistic information, both static and dynamic, that is couched within (a simplified form of) Discourse Representation Theory. It is shown that this solution is consistent with general theories of cognition and may shed some (novel) light on the nature of the FLN/FLB distinction.