Color inference from semantic labeling for person search in videos

Abstract

We propose an explainable model for classifying the color of pixels in images. We propose a method based on binary search trees and a large peer-labeled color name dataset, allowing us to synthesize the average human perception of colors. We test our method on the application of Person Search. In this context, persons are described from their semantic parts, such as hat, shirt,.. and person search consists in looking for people based on these descriptions. We label segments of pedestrians with their associated colors and evaluate our solution on datasets such as PCN and Colorful-Fashion. We show a precision as high as 83% as well as the model ability to generalize to multiple domains with no retraining.