Projection-based AR for dynamic objects by using high-speed optical axis control

Abstract

Recently, augmented reality (AR) by using a projector, which is often called projection-based AR, has been focused on and widely studied. We propose a projection-based AR system, named "Lumipen" for a high-speed or high-frequency object, using a 1000-fps vision sensor and a high-speed optical axis controller. Conventional research on projection-based AR has mainly focused on static objects or circumstances. In our system, the projected direction and projected image can be controlled based on the dynamic object behavior detected by a 1000-fps vision sensor. Instead of a rotational basement, the high-speed optical axis controller is an essential subsystem to catch up with the speed of the 1000-fps vision sensor. Lumipen is expected to provide high-quality visual information addition even in dynamic live content (e.g. a play, sport game, music concert) similar to CG in video content.