Mixed Reality HMI for Collaborative Robots

Abstract

Flexible production systems rely on simple reprogramming solution for the machines on the shop floor. Collaborative Robots play a crucial role in such manufacturing environments showing increasing potential for automation. Using digital twins for bidirectional communication show potential for improving the work between cobot and human. Therefore the development of a Mixed Reality HMI with a Microsoft HoloLens 2 for an ABB GoFa and to evaluate the benefits from such an application was the goal of this project. It was investigated which interfaces are shared by the robot and the HoloLens 2, which data from the robot can be displayed in which form in a mixed reality application and whether it is possible to control the robot with the HoloLens 2. The results show that it is possible to display data from the robot in near real-time and to control the robot with the gesture control of the glasses.