To Quantify an Image Relevance Relative to a Target 3D Object

Abstract

Given a 3D object, our purpose is to find, among numerous 2D images within databases, which ones represent this object the best. Selected images should be both informative and offer a relevant view of the object, i.e.a pose that presents the essential characteristic information about the 3D object. To estimate the quality of the view, we propose to rely on repeatable, second order features, extracted with a curvilinear saliency detector, in order to both compute the pose within the image and to build a relevance score, independent of colors and textures. Based on this score, and given a set of images containing the same object, we are able to rank images from the one that best showcases the object to the worst one. Neural networks dedicated to detection and classification are able to recognise the object with a confidence score. So, we also develop an automatic approach based on a confidence score extracted from Convolutional Neural Networks. For evaluating and comparing the deterministic and the learning based methods, we use an objective image ranking based on gradual simulated degradations. We also provide visual qualitative results on a real dataset. The results demonstrate the efficiency of the approaches, the robustness of the deterministic method and help understanding the behavior of the methods based on confidence score.