XCRAB: A content and annotation-based multimedia indexing and retrieval system

Abstract

During recent years, a new framework, which aims to bring a unified and global approach in indexing, browsing and querying various digital multimedia data such as audio, video and image has been developed. This new system partitions each media stream into smaller units based on actual physical events. These physical events within each media stream can then be effectively indexed for retrieval. In this paper, we present a new approach that exploits audio, image and video features to segment and analyze the audio-visual data. Integration of audio and visual analysis can overcome the weakness of previous approach that was based on the image or video analysis only. We implement a web-based multimedia data retrieval system called XCRAB and report on its experiment result. © Springer-Verlag Berlin Heidelberg 2004.