Enhance medical education and training using interactive autostereoscopic 3D display by in situ 3D interaction

Abstract

In this study, we proposed to combine autostereoscopic 3D display and interactive display to enhance medical education and training, which could be an alternative to the traditional medical education. We developed an enhanced 3D rendering algorithm for medical education and training based on the traditional lens based rendering algorithm (LBR). We used the system to perform a user study of medical visualization and education with a heart phantom, and a human-computer interaction device to capture hand motions, rotations, and gestures. Structure of the heart was labeled and validated by physician ahead. Furthermore, we devided 40 users (20 women and 20 men) into two groups: control group and experimental group, to operate a user study on anatomical structure of the heart phantom. Experimental results showed that our algorithm can achieve higher rendering performance than the traditional LBR. User test showed that 3D education system equipped by the enhanced LBR can achieve interactive display, and can thus promote education experience and reduce education time consuming. Further work includes more user studies on medical education and increasing frame rate of rendering for more versatile hardware configurations.