Architecture of a multimedia information system for content-based retrieval

Abstract

This paper describes a multimedia information system (MIS) that bridges the gap between the low level multimedia signal and high level semantic information which is useful in retrieving the data. We first describe the functionality expected of information systems and the types of data the system must manipulate. We then describe a four tiered data model for mapping between the signal and the semantics, and an architecture which integrates databases, knowledge bases, and vision systems to support the data model. Finally, we discuss some of the challenges to be addressed in underlying architecture to support the development of multimedia information systems.