From image annotation to image description

Abstract

In this paper, we address the problem of automatically generating a description of an image from its annotation. Previous approaches either use computer vision techniques to first determine the labels or exploit available descriptions of the training images to either transfer or compose a new description for the test image. However, none of them report results on the effect of incorrect label detection on the quality of the final descriptions generated. With this motivation, we present an approach to generate image descriptions from image annotation and show that with accurate object and attribute detection, human-like descriptions can be generated. Unlike any previous work, we perform an extensive task-based evaluation to analyze our results. © 2012 Springer-Verlag.