Interface for viewing 3D-reconstructed images using leap motion

Abstract

With recent advanced and complex medical technologies, viewing the locations of blood vessels and organs through 3D-reconstructed images during medical operations is essential for safe and accurate procedures. The conventional observation methods require the use of computer mice with the hand, which is inappropriate in sanitary environments such as operation rooms. We developed an application program for monitoring volume-rendered images using the Leap Motion, a remote-controlling device instead of conventional mice. In this study, we realized an interface that allows the users to have synchronized perception and understanding of holding 3D objects, which can be frustrating when using the Leap Motion, through the postures of fingers and timing input. In our demonstrational experiment, doctors reviewed that they could observe 3D location information in a sanitary manner through easy operations. This method proves the possibility of the Leap Motion becoming an indispensable device in diverse medical fields.