Augmented reality and MYO for a touchless interaction with virtual organs

Abstract

Recent years have seen revolutionary changes in CAS field thanks to the introduction of advanced Augmented Reality technologies. In this brief will be presented the overall study carried out in order to develop an AR application to support the doctor during the surgery. It will be described the way the surgeon can perform a more accurate diagnosis by using not just the traditional bidimensional grey-scale CT/MRI images, but also a more realistic three-dimensional marker-based visualization of the patient’s organs. Specific focus will be given to the extremely beneficial way the surgeon can interact with this kind of digital information in the operating room. It will be presented a highly innovative gesture-control device which allows the doctor to interact with IT equipment in a touchless and as natural as possible way, without coming into contact with it or interrupting the surgery, thus preserving the surgical environment from the danger of contamination.