Motion segmentation with census transform

Abstract

This paper presents a new approach to motion segmentation. Unlike most other methods, the proposed approach relies on summarized local image structure obtained by census transform, and not on absolute luminance values. We apply census transform for two frames from the sequence which are registered to the sub-pixel accuracy regarding to the moving target object. The registration is carried out by estimation of affine parameters. The two sets of resulting local image structures, in the forms of bit strings, give good and dense correspondence on the object to segment the region. We study the effectiveness of the sub-pixel registration compared to the pixel unit registration. We show segmentation results for natural scenes.