3D interaction assistance in virtual reality: A semantic reasoning engine for context-awareness

Abstract

This work focuses on 3D interaction assistance by adding adaptivity depending on the tasks, the objectives, and the general interaction context. An engine to reach context-awareness has been implemented in Prolog+CG which uses Conceptual Graphs (CGs) based on an ontology. CGs descriptions of the available sensors and actuators in our scene manager (Virtools) allow the engine to take decisions and send them through Open Sound Control (OSC). Measurements and adaptations corresponding to specific tools uses are decided from rules handled by the engine. This project is a step towards Intelligent Virtual Environments, which proposes a hybrid solution by adding a separate semantic reasoning to classic environments. The first experiment automatically manages few modalities depending on the distance to objects, user movement, available tools, etc. Gestures are used both as an engine direct control and as an interpretation of user activity. © 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering.