Laser projection augmented reality system for computer assisted surgery

Abstract

A new augmented reality apparatus was evaluated. The device uses scanned infrared and visible lasers to project computer generated information such as surgical plans, entry pints for probes etc, directly onto the patient. In addition to projecting the plan, the device can be integrated with a 3D camera and is capable of measuring the location of projected infrared laser spots. This can be used to ensure that the display is accurate, apply corrections to the projection path and to assist in registration. The projection system has its own Application Programmer’s Interface (API) and is a stand-alone add-on unit to any host computer system. Tests were conducted to evaluate the accuracy and repeatability of the system. We compared the locations of points projected on a flat surface with the measurements obtained from a tracked probe. The surface was rotated through 60 degrees in 5 degree increments and locations measured from the two devices agreed to within 2mm. An initial host application was also developed to demonstrate the new unit. Fiducials representing vertices along a proposed craniotomy were embedded into a plastic skull and a projection path defining the craniotomy was calculated. A feedback-based optimization of the plan was performed by comparing the measurement taken by the camera of these coordinates. The optimized plan was projected onto the skull. On average, the projection deviated by approximately 1mm from the plan. Applications include identification of critical anatomical structures, visualization of preplanned paths and targets, and telesurgery or teleconsultation.