Analysis of human motion and cognition ability with virtual reality system: Basic mechanism of human response

Abstract

When grasping an object, a human needs to recognize the object. In general, after the center of gravity of the object is recognized from the object shape, the human grasps a position close to the center of gravity. This research analyzes the relationship between the object shape and the sight trajectory until grasping. The proposed method traces finger motions when grasping the virtual 3D objects displayed on a screen by using finger motion capture device. In the motion, the sight trajectory is also measured and analyzed by using the eye tracking device. We conducted experiments with five subjects and analyzed the relationship between the variation of the line of sight trajectory and the size of the grasped object.