Online background-subtraction with motion compensation for freely moving camera

Abstract

This paper proposes a background subtraction method for moving camera. The method relies on motion compensation to transfers the background model from the previous frame to the current frame. This motion compensation is carried out using homography transformation where the homography matrix is estimated from the set of point correspondences between previous and current frame. In order to achieve a fast processing speed, optical-flows from grid-based key-points are calculated to define the point correspondences. The background segmentation itself consists of 3 components: background model, candidate background model, and candidate age. Those 3 parameters are used to define the stable pixels which are considered as the background pixels. The proposed method was tested on a public benchmark system and achieved promising result as shown in the experimental report. Moreover, the method is able to work on real time with 56 fps of processing speed.