Skip to content

An interdisciplinary VR-architecture for 3D chatting with non-verbal communication

by S. Gobron, J. Ahn, Q. Silvestre, D. Thalmann, S. Rank, M. Skowron, G. Paltoglou, M. Thelwall
Joint Virtual Reality Conference of EGVE 2011 - The 17th Eurographics Symposium on Virtual Environments, EuroVR 2011 - The 8th EuroVR (INTUITION) Conference ()
Get full text at journal


The communication between avatar and agent has already been treated from different but specialized perspectives. In contrast, this paper gives a balanced view of every key architectural aspect: from text analysis to computer graphics, the chatting system and the emotional model. Non-verbal communication, such as facial expression, gaze, or head orientation is crucial to simulate realistic behavior, but is still an aspect neglected in the simulation of virtual societies. In response, this paper aims to present the necessary modularity to allow virtual humans (VH) conversation with consistent facial expression-either between two users through their avatars, between an avatar and an agent, or even between an avatar and a Wizard of Oz. We believe such an approach is particularly suitable for the design and implementation of applications involving VHs interaction in virtual worlds. To this end, three key features are needed to design and implement this system entitled 3D-emoChatting. First, a global architecture that combines components from several research fields. Second, a real-time analysis and management of emotions that allows interactive dialogues with non-verbal communication. Third, a model of a virtual emotional mind called emoMind that allows to simulate individual emotional characteristics. To conclude the paper, we briefly present the basic description of a user-test which is beyond the scope of the present paper. © The Eurographics Association 2011.

Cite this document (BETA)

Authors on Mendeley

Readership Statistics

8 Readers on Mendeley
by Discipline
88% Computer Science
13% Business, Management and Accounting
by Academic Status
38% Student > Ph. D. Student
13% Student > Bachelor
13% Lecturer
by Country
25% United Kingdom
13% Switzerland
13% Portugal

Sign up today - FREE

Mendeley saves you time finding and organizing research. Learn more

  • All your research in one place
  • Add and import papers easily
  • Access it anywhere, anytime

Start using Mendeley in seconds!

Sign up & Download

Already have an account? Sign in