This work provides a framework for learning sequential attention in real-world visual object recognition, using an architecture of three processing stages. The first stage rejects irrelevant local descriptors based on an information theoretic saliency measure, providing candidates for foci of interest (FOI). The second stage investigates the information in the FOI using a codebook matcher and providing weak object hypotheses. The third stage integrates local information via shifts of attention, resulting in chains of descriptor-action pairs that characterize object discrimination. A Q-learner adapts then from explorative search and evaluative feedback from entropy decreases on the attention sequences, eventually prioritizing shifts that lead to a geometry of descriptor-action scanpaths that is highly discriminative with respect to object recognition. The methodology is successfully evaluated on indoors (COIL-20 database) and outdoors (TSG-20 database) imagery, demonstrating significant impact by learning, outperforming standard local descriptor based methods both in recognition accuracy and processing time.
CITATION STYLE
Paletta, L., Fritz, G., & Seifert, C. (2005). Q-learning of sequential attention for visual object recognition from informative local descriptors. In ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning (pp. 649–656). https://doi.org/10.1145/1102351.1102433
Mendeley helps you to discover research relevant for your work.