Next Frame Prediction Using Flow Fields

Abstract

Next frame prediction is the challenging task in computer vision and video prediction. Despite the longtime studies in video processing, the next frame prediction problem is rarely investigated and it is at its beginning. In next frame prediction, the main goal is to design a model which automatically generates the next frame using a sequence of previous frames. In videos, in most cases, the large portion of the current frame is similar to the previous frames and only a small portion of the frame has a motion field. This leads us to utilize the optic flow field. To do so, Laplacian pyramid of convolutional networks and adversarial learning are used to predict simultaneously the optic flow and the gray content of the next frame. To evaluate the proposed approach, it is applied on UCF101 dataset. The obtained results show that our approach achieves a better performance.