Projection Mapping: Interactive Operation using Kinect

Abstract

Recently “entertainment computing” (EC) technology becomes a hit term in Japan. There is a well-known “projection mapping” in this EC. Projection mapping is a video technique that synchronizes real space and virtual space, and the fascinating world view that the fusion of both produces attracts worldwide attention. On the other hand, recently, works combining dancer performance with projection mapping to create a fantastic world are drawing attention. However, in order to make the content persuasive, it is necessary for the performer to perform precise work, such as accurate alignment of the image coordinates of the moving object in the projection video, and it is not easy for everyone to do so. In this study, we aim to entertain not only the people who see the projection mapping but also the performer through the interaction with the projection mapping. So, we prototyped an interactive projection mapping that changes according to user’s movement by projecting to the user. This time we focused on sports like baseball and soccer, and we projected the ball to the user by projection mapping so that we can experience pitching and lifting. Furthermore, we conducted a questionnaire survey to evaluate the sense of use of this system, and the results showed that many people can enjoy by this projection mapping.