A new approach to evaluating novel recommendations

  • Celma Ò
  • Herrera P
  • 128


    Mendeley users who have this article in their library.
  • 90


    Citations of this article.


This paper presents two methods, named Item– and User– centric, to evaluate the quality of novel recommendations. The formermethod focuses on analysing the item–based rec- ommendation network. The aim is to detect whether the network topology has any pathology that hinders novel rec- ommendations. The latter, user–centric evaluation, aims at measuring users’ perceived quality of novel recommenda- tions. The results of the experiments, done in the music recom- mendation context, show that last.fm social recommender, based on collaborative filtering, is prone to popularity bias. This has direct consequences on the topology of the item– based recommendation network. Pure audio content–based methods (CB) are not affected by popularity. However, a user–centric experiment done with 288 subjects shows that even though a social–based approach recommends less novel items than our CB, users’ perceived quality is better than those recommended by a pure CB method.

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document


  • Òscar Celma

  • Perfecto Herrera

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free