Random matrix ensembles of time correlation matrices to analyze visual lifelogs

Abstract

Visual lifelogging is the process of automatically recording images and other sensor data for the purpose of aiding memory recall. Such lifelogs are usually created using wearable cameras. Given the vast amount of images that are maintained in a visual lifelog, it is a significant challenge for users to deconstruct a sizeable collection of images into meaningful events. In this paper, random matrix theory (RMT) is applied to a cross-correlation matrix C, constructed using SenseCam lifelog data streams to identify such events. The analysis reveals a number of eigenvalues that deviate from the spectrum suggested by RMT. The components of the deviating eigenvectors are found to correspond to "distinct significant events" in the visual lifelogs. Finally, the cross-correlation matrix C is cleaned by separating the noisy part from the non-noisy part. Overall, the RMT technique is shown to be useful to detect major events in SenseCam images. © 2014 Springer International Publishing.