Rendering ultrasound pressure distribution on hand surface in real-time

Abstract

In this paper, we propose a method for rendering the pressure distribution on the skin surface of a hand in real-time using an ultrasonic phased array. Our method generates a polygon mesh model representing the hand shape by fitting a rigid template to the point cloud captured by depth sensors. Obtaining the entire hand shape as a mesh model enables to solve scattering problem to generate a precise distribution on the hand surface. Therefor, for example, our method can control the width of the distribution on the fingertip according to the size of the contact area with the virtual object. We have experimentally verified that considering the scattering on the mesh model contributes to accurate pressure pattern reproduction.