Audio-assisted video browsing for DVD recorders

Abstract

We present an audio-assisted video browsing system for a Hard Disk Drive (HDD) enhanced DVD recorder. We focus on our sports highlights extraction based on audio classification. We have systematically established that sports highlights are indicated by the presence of audience reaction such as cheering, applause and the commentator's excited speech. That enables us to develop a common highlights extraction technique, based on detection of audience reaction, for five different sports, viz. soccer, baseball, golf, sumo wrestling and horseracing. Our extraction accuracy is high: Furthermore, the percentage duration of the audience reaction gives us a simple importance measure for each of the highlights. We can then get a summary of any desired length by appropriately choosing a threshold for the importance measure. We process the AC-3 audio directly thereby enabling simple integration of our technique into our target platform. © Springer-Verlag Berlin Heidelberg 2004.