Consistent sparse representation for video-based face recognition

Abstract

This paper presents a novel method named Consist Sparse Representation (CSR) to solve the problem of video-based face recognition. We treat face images from each set as an ensemble. For each probe set, our goal is that the non-zero elements of the coefficient matrix can ideally focus on the gallery examples from a few/one subject(s). To obtain the sparse representation of a probe set, we simultaneously consider group-sparsity of gallery sets and probe sets. A new matrix norm (i.e. lF,0-mixed norm) is designed to describe the number of gallery sets selected to represent the probe set. The coefficient matrix is obtained by minimizing the lF,0-mixed norm which directly counts the number of gallery sets used to represent the probe set. It could better characterize the relations among classes than previous methods based on sparse representation. Meanwhile, a special alternating optimization strategy based on the idea of introducing auxiliary variables is adopted to solve the discontinuous optimization problem. We conduct extensive experiments on Honda, COX and some image set databases. The results demonstrate that our method is more competitive than those state-of-the-art video-based face recognition methods.