Metric index: An efficient and scalable solution for similarity search

by David Novak, Michal Batko
2009 2nd International Workshop on Similarity Search and Applications, SISAP 2009 ()
Get full text at journal

Abstract

Metric space as a universal and versatile model of similarity can be applied in various areas of non-text information retrieval. However, a general, efficient and scalable solution for metric data management is still a resisting research challenge. We introduce a novel indexing and searching mechanism called metric index (M-Index), that employs practically all known principles of metric space partitioning, pruning and filtering. The heart of the M-Index is a general mapping mechanism that enables to actually store the data in well-established structures such as the B<sup>+</sup>-tree or even in a distributed storage. We have implemented the M-Index with B<sup>+</sup>-tree and performed experiments on a combination of five MPEG-7 descriptors in a database of hundreds of thousands digital images. The experiments put under test several M-Index variants and compare them with two orthogonal approaches - the PM-Tree and the iDistance. The trials show that the M-Index outperforms the others in terms of efficiency of search-space pruning, I/O costs, and response times for precise similarity queries. Furthermore, the M-Index demonstrates an excellent ability to keep similar data close in the index which makes its approximation algorithm very efficient-maintaining practically constant response times while preserving a very high recall as the dataset grows.

Cite this document (BETA)

Authors on Mendeley

Readership Statistics

22 Readers on Mendeley
by Discipline
 
by Academic Status
 
27% Ph.D. Student
 
23% Student (Master)
 
14% Researcher (at an Academic Institution)
by Country
 
14% Brazil
 
5% Russia
 
5% Portugal

Sign up today - FREE

Mendeley saves you time finding and organizing research. Learn more

  • All your research in one place
  • Add and import papers easily
  • Access it anywhere, anytime

Start using Mendeley in seconds!

Sign up & Download

Already have an account? Sign in