Invoked computing: Spatial audio and video AR invoked through miming

Abstract

Direct interaction with everyday objects augmented with artificial affordances is clearly a very efficient approach leveraging natural human interaction capabilities. Hence the idea of conceiving ubiquitous computing as an invisible world which can be “condensed” on real objects. Rich Gold’s [1] described ubiquitous computing field as an “enchanted village” in which people discover hidden affordances in everyday objects. With this project, we explore the reverse scenario: a ubiquitous intelligence capable of discovering affordances suggested or represented symbolically by human beings (as actions and scenarios involving objects and drawings). An example: taking a banana and bringing it closer to the ear. The gesture is clear enough: directional microphones and parametric speakers hidden in the room would make the banana function as a real handset on the spot.