Task-oriented sparse coding model for pattern classification

Abstract

Although the basic sparse coding model has been quite successful at explaining the receptive fields of simple cells in V1, it ignores an important constrain: perception task. We put forward a novel sparse coding model, called task-oriented sparse coding (TOSC) model, combining the discriminability constrain supervised by classification task, besides the sparseness criteria. Simulation experiments are performed using real images including class of scene and class of building. The results show that TOSC can organize some significant receptive fields with distinct topological structure which will favor the classification task. Moreover, the coefficients of TOSC notablely improve the classification accuracy, from the 53.5% of pixel-based model to 86.7%, in the case of none distinct damage on the performance of reconstruction error and sparseness. TOSC model, complementing the feedback sparse coding model, is more consistent with biological mechanism, and shows good potential in the feature extraction for pattern classification. © Springer-Verlag Berlin Heidelberg 2005.