Augmented reality visualization for computer assisted surgical training

Abstract

Laparoscopic surgical training systems limit the users' depth perception and hand-eye coordination due to the use of a 2D camera image. In this paper, we present an approach to enhance visualization using augmented reality which aids in hand-eye coordination and depth perception in the operating environment. An optimal path is calculated in a 3D space and projected onto a 2D camera image. The mapping from the 3D to 2D coordinate system is calculated using least squares camera calibration method. Instrument tip location in space is calculated using feedback from encoders attached to them. We combine the information about the instrument tip and optimal path to achieve robust visualization. © 2013 Springer-Verlag Berlin Heidelberg.