Leveraging Passage-level Cumulative Gain for Document Ranking

36Citations
Citations of this article
22Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Document ranking is one of the most studied but challenging problems in information retrieval (IR) research. A number of existing document ranking models capture relevance signals at the whole document level. Recently, more and more research has begun to address this problem from fine-grained document modeling. Several works leveraged fine-grained passage-level relevance signals in ranking models. However, most of these works focus on context-independent passage-level relevance signals and ignore the context information, which may lead to inaccurate estimation of passage-level relevance. In this paper, we investigate how information gain accumulates with passages when users sequentially read a document. We propose the context-aware Passage-level Cumulative Gain (PCG), which aggregates relevance scores of passages and avoids the need to formally split a document into independent passages. Next, we incorporate the patterns of PCG into a BERT-based sequential model called Passage-level Cumulative Gain Model (PCGM) to predict the PCG sequence. Finally, we apply PCGM to the document ranking task. Experimental results on two public ad hoc retrieval benchmark datasets show that PCGM outperforms most existing ranking models and also indicates the effectiveness of PCG signals. We believe that this work contributes to improving ranking performance and providing more explainability for document ranking.

Cite

CITATION STYLE

APA

Wu, Z., Mao, J., Liu, Y., Zhan, J., Zheng, Y., Zhang, M., & Ma, S. (2020). Leveraging Passage-level Cumulative Gain for Document Ranking. In The Web Conference 2020 - Proceedings of the World Wide Web Conference, WWW 2020 (pp. 2421–2431). Association for Computing Machinery, Inc. https://doi.org/10.1145/3366423.3380305

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free