Tracklet reidentification in crowded scenes using bag of spatio-temporal histograms of oriented gradients

Abstract

A novel tracklet association framework is introduced to perform robust online re-identification of pedestrians in crowded scenes recorded by a single camera. Recent advances in multi-target tracking allow the generation of longer tracks, but problems of fragmentation and identity switching remain, due to occlusions and interactions between subjects. To address these issues, a discriminative and efficient descriptor is proposed to represent a tracklet as a bag of independent motion signatures using spatio-temporal histograms of oriented gradients. Due to the significant temporal variations of these features, they are generated only at automatically identified key poses that capture the essence of its appearance and motion. As a consequence, the re-identification involves only the most appropriate features in the bag at given time. The superiority of the methodology is demonstrated on two publicly available datasets achieving accuracy over 90% of the first rank tracklet associations. © 2013 Springer-Verlag Berlin Heidelberg.