Inferring stochastic regular grammar with nearness information for human action recognition

Abstract

In this paper, we present an extended scheme of human action recognition with nearness information between hands and other body parts for the purpose of automatically analyzing nonverbal actions of human beings. First, based on the principle that a human action can be defined as a combination of multiple articulation movements, we apply the inference of stochastic grammars. We measure and quantize each human action in 3D coordinates and make two sets of 4-chain-code for xy and zy projection planes, so that they are appropriate for the stochastic grammar inference method. Next, we extend the stochastic grammar inferring method by applying nearness information. We confirm that various physical actions are correctly classified against a set of real-world 3D temporal data with this method in experiments. Our experiments show that this extended method reveals comparatively successful achievement with a 92.7% recognition rate of 60 movements of the upper body. © Springer-Verlag Berlin Heidelberg 2006.