Ai-STRATA: A user-centered model for content-based description and retrieval of audiovisual sequences?

Abstract

We first insist on the need for conceptual and knowledge- based audiovisual (AV) models in AV and multimedia information retrieval systems.We then propose several criteria for characterizing audiovisual representation approaches, and present a new approach for mod- eling and structuring AV documents with Annotations Interconnected Strata (AI-STRATA). This consists in analyzing AV documents through analysis dimensions allowing the detection of objects of interest of any type (structural, conceptual. ). Annotations are structured by annotation elements (AE) representing both objects of interest and relationships. A knowledge base is used in order to monitor the annotation process. We show how to use annotations to link difierent strata on the base of explicit or implicit contexts and how AI-Strata can be used to build contextual views of a stratum, using both annotation and knowledge levels. We finally show how the model can effciently support difierent description tasks such as indexing, searching and browsing audiovisual material.