EigenSegments: A spatio-temporal decomposition of an ensemble of images

Abstract

Eigensegments combine image segmentation and Principal Component Analysis (PCA) to obtain a spatio-temporal decomposition of an ensemble of images. The image plane is spatially decomposed into temporally correlated regions. Each region is independently decomposed temporally using PCA. Thus, each image is modeled by several low-dimensional segment-spaces, instead of a single high-dimensional image-space. Experiments show the proposed method gives better classification results, gives smaller reconstruction errors, can handle local changes in appearance and is faster to compute. Results for faces and vehicles are shown.