Considering Conversation Scenes in Movie Summarization

Abstract

Given that manual video summarization is time consuming and calls for a high level of expertise, an effective automatic video summarization method is required. Although existing video summarization methods are usable for some videos, when they are applied to story-oriented videos such as movies, it sometimes becomes difficult to understand the stories from the generated summaries because they often lack continuity. In this paper, we propose a method for summarizing videos that can convey the story beyond the sequence of extracted shots so that they can fit user perception patterns. In particular, we examine the impact of conversation scenes in movie storytelling. The evaluation of summarized videos is another challenge because existing evaluation methods for text summarization cannot be directly applied to video summarization. Therefore, we propose a method for comparing summarized movies that maintains the integrity of conversation scenes with those that do not. We demonstrate how preserving conversational aspects influences the quality of summarized videos.