Karaoke entertainment character based on user behavior recognition

Abstract

In recent years, research on CG technology has advanced. However, the current CG character can only perform deterministic behavior; there is a problem that interaction cannot be real. Therefore, it is necessary to change the facial expression and gaze in real time to the user by the CG character to select a specific user in the space where there are multiple users, and to do real interaction with the user by using the episode control system and user recognition. In this paper, Kinect V2 recognizes the behavior of a specific user from multiple users, generates a complex gesture of CG characters, gaze representation etc., and proposes a system that CG character supports the provision of services. In this paper, we verify behavior recognition when there is one user and verify behavior recognition by priority when there are multiple users. Because there were many misrecognition of the skeleton, there were many times when the behavior was not recognized. In the evaluation experiments, we will realize even CG character’s behavior generation in relation to episode control technology.