We discuss the evaluation of rankings of documents that aim to summarize the overall opinion expressed in product reviews. Such a ranking can be used by e-commerce websites to represent a gist of the public opinion about a product. The inability of traditional IR metrics to reward such a representation is argued for. A matrix based labelling procedure serves as the framework for such evaluation. Three alternative metrics are adapted from previous similar works to evaluate opinion representativeness. Similarly, two metrics are adapted for exhaustiveness. Finally, we compare the robustness of these metrics.
CITATION STYLE
Singh, A. K., Thawani, A., Gupta, A., & Mundotiya, R. K. (2017). Evaluating Opinion Summarization in Ranking. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 10648 LNCS, pp. 222–234). Springer Verlag. https://doi.org/10.1007/978-3-319-70145-5_17
Mendeley helps you to discover research relevant for your work.