We present an empirical analysis of the effect that the gain and discount functions have in the correlation between DCG and user satisfaction. Through a large user study we estimate the relationship between satisfaction and the effectiveness computed with a test collection. In particular, we estimate the probabilities that users find a system satisfactory given a DCG score, and that they agree with a difference in DCG as to which of two systems is more satisfactory. We study this relationship for 36 combinations of gain and discount, and find that a linear gain and a constant discount are best correlated with user satisfaction.
CITATION STYLE
Urbano, J., & Marrero, M. (2015). How do gain and discount functions affect the correlation between DCG and user satisfaction? In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9022, pp. 197–202). Springer Verlag. https://doi.org/10.1007/978-3-319-16354-3_20
Mendeley helps you to discover research relevant for your work.