The evaluation of effectiveness in InformationRetrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval: a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem: bpref and Normalized Lift Curves. ©2007 Austrian Computer Society (OCG).
CITATION STYLE
Serrà, J. (2007). A qualitative assessment of measures for the evaluation of a cover song identification system. In Proceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007 (pp. 319–322).
Mendeley helps you to discover research relevant for your work.