This paper presents a multimodal simulation system, project- SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.
CITATION STYLE
Miri, H., Kolkmeier, J., Taylor, P. J., Poppe, R., & Heylen, D. (2017). project SENSE – Multimodal simulation with full-body real-time verbal and nonverbal interactions. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (Vol. 178, pp. 279–284). Springer Verlag. https://doi.org/10.1007/978-3-319-49616-0_28
Mendeley helps you to discover research relevant for your work.