Gait Identification by Joint Spatial-Temporal Feature

Abstract

In order to extract the gait spatial-temporal feature, we propose a novel Long-Short Term Memory (LSTM) network for gait recognition in this paper. Given a gait sequence, a CNNs unit with three layers convolution neural networks is used to extract the spatial feature. Then the spatial feature vector is sent to the LSTM unit, which is used to extract the temporal feature. Based on the spatial-temporal feature vector, the triplet loss function is adopted to optimize the network parameters. The CNNs and LSTM unit are jointly trained to act as a gait spatial-temporal feature extractor for the gait recognition system. Finally extensive evaluations are carried out on the CASIA-B dataset. The results turn out that our network performs better than previous state-of-the art method. It shows great potential for the practical application.