An Open Framework for Nonverbal Communication in Human-Robot Interaction

0Citations
Citations of this article
2Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Nonverbal communication plays a vital role in human interaction. In the context of Human-Robot Interaction (HRI), social robots are designed primarily for verbal-based communication with humans, making nonverbal communication an open research area. We present a flexible, open framework designed to facilitate nonverbal interactions in HRI. Among its components is a P2P Browser-Based Computational Notebook, leveraged to code, run, and share reactive programs. Machine-learning models can be included for real-time recognition of gestures, poses, and moods, employing protocols such as MQTT. Another key component is a broker for distributing data among different physical devices like the robot, wearables, and environmental sensors. We demonstrate this framework’s utility through two interaction scenarios: (i) the first one employing proxemics and gaze direction to initiate an impromptu encounter, and (ii) a second one incorporating object recognition and a Large-Language Model to suggest meals to be cooked based on available ingredients. These scenarios illustrate how the framework’s components can be seamlessly integrated to address new scenarios, where robots need to infer nonverbal cues from users.

Cite

CITATION STYLE

APA

Lozano, E. A., Sánchez-Torres, C. E., López-Nava, I. H., & Favela, J. (2023). An Open Framework for Nonverbal Communication in Human-Robot Interaction. In Lecture Notes in Networks and Systems (Vol. 842 LNNS, pp. 21–32). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-48642-5_3

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free