How Video Super-Resolution and Frame Interpolation Mutually Benefit

10Citations
Citations of this article
10Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Video super-resolution (VSR) and video frame interpolation (VFI) are inter-dependent for enhancing videos of low resolution and low frame rate. However, most studies treat VSR and temporal VFI as independent tasks. In this work, we design a spatial-temporal super-resolution network based on exploring the interaction between VSR and VFI. The main idea is to improve the middle frame of VFI by the super-resolution (SR) frames and feature maps from VSR. In the meantime, VFI also provides extra information for VSR and thus, through interacting, the SR of consecutive frames of the original video can also be improved by the feedback from the generated middle frame. Drawing on this, our approach leverages a simple interaction of VSR and VFI and achieves state-of-the-art performance on various datasets. Due to such a simple strategy, our approach is universally applicable to any existing VSR or VFI networks for effectively improving their video enhancement performance.

Cite

CITATION STYLE

APA

Zhou, C., Lu, Z., Li, L., Yan, Q., & Xue, J. H. (2021). How Video Super-Resolution and Frame Interpolation Mutually Benefit. In MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia (pp. 5445–5453). Association for Computing Machinery, Inc. https://doi.org/10.1145/3474085.3475672

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free