A system for reconstruction of missing data in image sequences using sampled 3D AR models and MRF motion priors

Abstract

This paper presents a new technique for interpolating missing data in image sequences. A 3D autoregressive (AR) model is employed and a sampling based interpolator is developed in which reconstructed data is generated as a typical realization from the underlying AR process, rather than e.g. least squares (LS). In this way a perceptually improved result is achieved. A hierarchical gradient-based motion estimator, robust in regions of corrupted data, employing a Markov random field (MRF) motion prior is also presented for the estimation of motion before interpolation.