Occluded Person Re-Identification With Pose Estimation Correction and Feature Reconstruction

Abstract

In the real-world surveillance system application, the accuracy of person re-identification (Re-ID) still suffers from occlusion. Occluded Re-ID aims to retrieve occluded person images from multiple cameras that do not overlap. To address this issue, we present a multi-branch feature enhancement network in this paper. It has the pose correction module (PCM), the feature reconstruction module (FRM), and the part align module (PAM). PCM builds the key-points confidence corrected mechanism of the self-adaptive weights learning before the part matching stage to strengthen part-level features in the non-occluded region and weaken ones in the occluded region. FRM reconstructs the feature distribution of inter-domain and class-domain using the maximum mean discrepancy to generalize the global features. The proposed feature separation mechanism enables the two branches to attend to distinct pedestrian feature. To increase the power of representation, PAM combines part-level and global features in an outer product. The experimental results on three holistic datasets, two partial datasets, and two occluded datasets demonstrate that our method is superior. It significantly outperforms state-of-the-art by 5.7% and 4.4% rank-1 scores on Occluded-Duke and Occluded-REID, respectively.