Enhancing human computer interaction in networked hapto-acoustic virtual reality environments on the CeNTIE network

Abstract

We discuss some recent advances made to our Virtual Reality system which includes touch feedback in a networked environment. Some issues which affect the realisation and implementation of the Hapto-Acoustic Virtual Reality Environment and human-computer interaction (HCI) are mentioned, as well as networking issues. Our system is called a "haptic workbench" which combines 3D graphics visualisation, touch (haptics) and audio interaction with a computer generated model. The aim is to produce a semi-immersive 3D environment, experienced in real time by the user. Networking two or more systems makes it possible to collaborate in the virtual space and achieve a sense of perceived virtual presence. Recent additions to the system in the form of real time video with audio is demonstrated and shown to enhance the level of virtual presence in the networked environment. Such face to face communication with the remote user in addition to haptic and audio collaboration with the virtual model adds to the sense of presence between users. Two methods of sending video over the internet are compared and our example implementation is described. These additions make it possible to add value in learning scenarios and opens up the possibility of increasing participation during a training session. © Springer-Verlag 2004.