Haptics-enabled surgical training system with guidance using deep learning

Abstract

In this paper, we present a haptics-enabled surgical training system integrated with deep learning for characterization of particular procedures of experienced surgeons to guide medical residents-in-training with quantifiable patterns. The prototype of virtual reality surgical system is built for open-heart surgery with specific steps and biopsy operation. Two abstract surgical scenarios are designed to emulate incision and biopsy surgical procedures. Using deep learning algorithm (autoencoder), the two surgical procedures were trained and characterized. Results show that a vector with 30 real-valued components can quantify both surgical patterns. These values can be used to compare how a resident- in-training performs differently as opposed to an experienced surgeon so that quantifiable corrective training guidance can be provided.