Smart Surveillance Based on Video Summarization: A Comprehensive Review, Issues, and Challenges

Abstract

In order to ensure the protection and safety of the public, intelligent video surveillance systems are used in a wide range of applications to monitor events and analyze activities. A huge data is being generated, processed, and stored for security reasons from a single or multi-monitoring camera. Owing to a time limit, an analyst is going through a laborious process of examining the most important incidents from vast video databases. As a result, Video Summarization is a smart solution to summarize the salient events by removing the redundant frames which facilitate fast searching, indexing, and quick sharing of the content automatically. This paper investigates existing video summarization Techniques and a comparison of various existing approaches and methods in the surveillance domain. It also presents insight into video summarization in traffic surveillance which can be used to address the ever-growing needs of Intelligent Transportation System (ITS). The present study will be useful in integrating essential research findings and data for quick reference, identifying existing work, and investigating possible directions for future research in video summarization for traffic surveillance.