Automatic context analysis for image classification and retrieval

Abstract

This paper describes a method for image classification and retrieval for natural and urban scenes. The proposed algorithm is based on hierarchical image contents analysis. First image is classified as urban or natural according to color and edge distribution properties. Additionally scene is classified according to its conditions: illumination, weather, season and daytime based on contrast, saturation and color properties of the image. Then image content is analyzed in order to detect specific object classes: buildings, cars, trees, sky, road etc. To do so, image recursively divided into rectangular blocks. For each block probabilities of membership in the specific class is computed. This probability computed as a distance in a feature space defined by optimal feature subset selected on the training step. Blocks which can not be assigned to any class using computed features are separated into 4 sub-blocks which analyzed recursively. Process stopped then all blocks are classified or size of block is smaller then predefined value. Training process is used to select optimal feature subset for object classification. Training set contains images with manually labeled objects of different classes. Each image additionally tagged with scene parameters (illumination, weather etc). © 2011 Springer-Verlag.