Characterizing multimedia objects through multimodal content analysis and fuzzy fingerprints

Abstract

In this paper we introduce a new approach to multimedia data semantic characterisation and in particular television programmes fingerprinting, based on multimodal content analysis and fuzzy clustering. The definition of the fingerprints can be seen as a space transformation process, which maps each programme description from the surrogate vector space to a new vector space, defined through a fuzzy clustering method. The fuzzy fingerprint model is well suited for similarity based information retrieval, and it captures "semantic" similarities coming from common pattern in the programme data, at different semantic levels. © Springer-Verlag Berlin Heidelberg 2009.