Virtual reality and augmented reality applied to endoscopic and notes procedures

Abstract

Computer-assisted surgery led to a major improvement in medicine. Such an improvement can be summarized in three major steps. The first one consists in an automated 3D modelling of patients from their medical images. The second one consists in using this modelling in surgical planning and simulation software offering then the opportunity to train the surgical gesture before carrying it out. The last step consists in intraoperatively superimposing preoperative data onto the real view of patients. This Augmented Reality provides surgeons a view in transparency of their patient allowing to track instruments and improve pathology targeting. We will present here our results in these different domains applied to endoscopic and NOTES procedures.