Anatomical 2D/3D shape-matching in virtual reality: A user interface for quantifying joint kinematics with radiographic imaging

Abstract

We introduce a virtual reality 3D user interface (3DUI) for anatomical 2D/3D shape-matching, a challenging task that is part of medical imaging processes required by biomechanics researchers. Manual shape-matching can be thought of as a nuanced version of classic 6 degree-of-freedom docking tasks studied in the 3DUI research community. Our solution combines dynamic gain for precise translation and rotation from 6 degree-of-freedom tracker input, constraints based on both 2D and 3D data, and immersive visualization and visual feedback.