Retrieval of Structured and Unstructured Data with vitrivr

Abstract

With the increase in sensory capability of mobile devices, the data that can be generated and used in a lifelogging context gets increasingly diverse. Such data is special in the context of multimedia, not only because of its close personal relationship with its originator, but also because of its diverse multimodality and its composition from structured, semi-structured, and unstructured data. This diversity poses retrieval challenges that are unique to lifelog data but which also have implications for retrieval activity in other multimedia domains. In this paper, we present the extensions made to the vitrivr opensource multimedia retrieval stack, in order to address some of these unique lifelogging challenges. For the participation to the 2019 Lifelog Search Challenge (LSC), we have extended vitrivr with the capability to process Boolean query expressions alongside contentbased query descriptions in order to leverage the structural diversity inherent to lifelog data.