Digital Video Stabilization and Rolling Shutter Correction using Gyroscopes

Abstract

In this paper we present a robust, real-time video stabilization and rolling shutter correction technique based on commodity gy- roscopes. First, we develop a unified algorithm for modeling cam- era motion and rolling shutter warping. We then present a novel framework for automatically calibrating the gyroscope and camera outputs from a single video capture. This calibration allows us to use only gyroscope data to effectively correct rolling shutter warp- ing and to stabilize the video. Using our algorithm, we show results for videos featuring large moving foreground objects, parallax, and low-illumination. We also compare our method with commercial image-based stabilization algorithms. We find that our solution is more robust and computationally inexpensive. Finally, we imple- ment our algorithm directly on a mobile phone. We demonstrate that by using the phone’s inbuilt gyroscope and GPU, we can re- move camera shake and rolling shutter artifacts in real-time.