Fluorescence-based enhanced reality for colorectal endoscopic surgery

Abstract

Minimally Invasive Surgery (MIS) application using computer vision algorithms, helps surgeons to increase intervention safety. With the availability of the fluorescence camera in MIS surgery, the anastomosis procedure becomes safer to avoid ischemia.We propose an Augmented Reality (AR) software that non-rigidly registers the ischemic map based on fluorescence signal on the live endoscopic sequence. The efficiency of the proposed system relies on robust feature tracking and accurate image registration using image deformation. Experimental results on in-vivo data have shown that the proposed system satisfies the clinical requirements. © 2014 Springer International Publishing.