Portable High-Speed Optical Gaze Controller with Vision Chip

Abstract

It is important to miniaturize robot systems while maintaining advantages such as high responsiveness and functionality for human-machine interactions and for achieving integration with other robotic systems such as drones. In this research, we focused on the miniaturization of a high-speed visual feedback system, and developed a “portable saccade mirror,” which is a system that can realize active target tracking using 1000 Hz image capturing, processing, and feedback actuation with only 3 ms latency in a hand-held device. By using a three-dimensionally-stacked vision chip, the proposed system achieved high speed, low latency, low power consumption and compact size, and therefore, can be considered as a good example of a miniaturized high-speed visual feedback system. In this study, we evaluated the performance of the proposed system in comparison with the conventional optical gaze controller, and demonstrated some applications, such as tracking field scope and panorama target scanning.