Dynamic textures are sequences of images of moving scenes that exhibit certain stationarity properties in time; these include sea-waves, smoke, foliage, whirlwind but also talking faces, traffic scenes etc. We present a novel characterization of dynamic textures that poses the problems of modelling, learning, recognizing and synthesizing dynamic textures on a firm analytical footing. We borrow tools from system identification to capture the "essence" of dynamic textures; we do so by learning (i.e. identifying) models that are optimal in the sense of maximum likelihood or minimum prediction error variance. For the special case of second-order stationary processes we identify the model in closed form. Once learned, a model has predictive power and can be used for extrapolating synthetic sequences to infinite length with negligible computational cost. We present experimental evidence that, within our framework, even low dimensional models can capture very complex visual phenomena.
CITATION STYLE
Soatto, S., Doretto, G., & Wu, Y. N. (2001). Dynamic textures. In Proceedings of the IEEE International Conference on Computer Vision (Vol. 2, pp. 439–446). https://doi.org/10.1007/978-1-4471-4902-6_5
Mendeley helps you to discover research relevant for your work.