Three-dimensional operating room with unlimited perspective

Abstract

Apart from operating tables and modern surgical instruments, the modern operating rooms are equipped with displays and video surveillance systems. The three-dimensional operating room allows users to watch medics perform surgery from different, individually chosen, points of view. For the first time, it is possible to reproduce/repeat the course of the operations and change the perspective or position, from which it is observed. Here, we proposed a solution based on Microsoft HoloLens and Azure Kinect DK devices as remote support to patient management. The operating room is transferred to the digital form in real-time using Augmented Reality based technologies. Users can move around the digital place like a ghost in real space. The approach proposed allows users to see observe surgery from any point of view they want without disturbing the surgeon’s workflow. They can change their positions, angle, and place of observation. All environmental restrictions disappear. The presented solution gives trainees a convenient opportunity to learn. It may make a significant contribution to improving the surgeon training, patients’ outcomes, and may allow virtual medical consultations during the surgery between specialists without them leaving their workplace.