Development of recognition system of Japanese sign language using 3D image sensor

Abstract

The population of Japanese people with disabilities is growing day by day. And the population of sign language translator is too few to support them. In general life, people communicate with others through conversation but this is obviously impossible for deaf mute people who use sign language to communicate. So it is necessary to explore a recognition system of sign language which can help the deaf and mute to keep in touch with others. In order to solve that problem, a large amount of researches related to recognition system development and establishment have been reported by previous literatures. However, current paper introduced a novel method for system developing. In this paper, 3D sensors called Kinect were employed for hand gesture dataset's collection following by data dealing from transformation matrix based on specific formulas. Although the hand gesture can be captured, but there still are a lot of noises left, so PCL (Point Cloud Library) was applied to do the 3D data processing. © Springer-Verlag Berlin Heidelberg 2013.