New Design Potentials of Non-mimetic Sonification in Human-Robot Interaction

Abstract

With the increasing use and complexity of robotic devices, the requirements for the design of human-robot interfaces are rapidly changing and call for new means of interaction and information transfer. On that scope, the discussed project - being developed by the Hybrid Things Lab at the University of Applied Sciences Augsburg and the Design Research Lab at Bauhaus-Universität Weimar - takes a first step in characterizing a novel field of research, exploring the design potentials of non-mimetic sonification in the context of human-robot interaction. Featuring an industrial seven-axis manipulator and collecting multiple information (for instance, the position of the end-effector, joint positions and forces) during manipulation, these datasets are being used for creating a novel augmented audible presence and thus allowing new forms of interaction. As such, this article considers(1)research parameters for non-mimetic sonification (such as pitch, volume, and timbre);(2)a comprehensive empirical pursuit, including setup, exploration, and validation;(3)the overall implications of integrating these findings into a unifying human-robot interaction process. The relation between machinic and auditory dimensionality is of particular concern.