Temporal dynamical interactions between multiple layers of local image features for event detection in video sequences

Abstract

In this paper an approach for storing and employing local image features in video processing is presented. The approach is based on the usage of memory cells representing local image features and (non-fixed) spatial positions, which are organized in memory layers. By assigning frame-based recall function and learning procedure to the cells, the memory layers establish a content-based auto-associative memory. Thus, they can be applied to solve several event detection tasks, as it is exemplified by dynamic background supression in a traffic scene, and counting of persons halting before a shopping window in an indoor scene. The case studies suggest that information gathered from the cells (like cell history based scoring values) can be used in various manners for video processing tasks circumventing the need for object segmentation and tracking, typical in many conventional background-differencing methods. © Springer-Verlag 2003.