Meta Policy Learning for Cold-Start Conversational Recommendation

23Citations
Citations of this article
16Readers
Mendeley users who have this article in their library.

Abstract

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users. However, for users new to the system, such a global policy becomes ineffective to satisfy them, i.e., the cold-start challenge. In this paper, we study CRS policy learning for cold-start users via meta reinforcement learning. We propose to learn a meta policy and adapt it to new users with only a few trials of conversational recommendations. To facilitate fast policy adaptation, we design three synergetic components. Firstly, we design a meta-exploration policy dedicated to identifying user preferences via a few exploratory conversations, which accelerates personalized policy adaptation from the meta policy. Secondly, we adapt the item recommendation module for each user to maximize the recommendation quality based on the collected conversation states during conversations. Thirdly, we propose a Transformer-based state encoder as the backbone to connect the previous two components. It provides comprehensive state representations by modeling complicated relations between positive and negative feedback during the conversation. Extensive experiments on three datasets demonstrate the advantage of our solution in serving new users, compared with a rich set of state-of-the-art CRS solutions.

Cite

CITATION STYLE

APA

Chu, Z., Wang, H., Xiao, Y., Long, B., & Wu, L. (2023). Meta Policy Learning for Cold-Start Conversational Recommendation. In WSDM 2023 - Proceedings of the 16th ACM International Conference on Web Search and Data Mining (pp. 222–230). Association for Computing Machinery, Inc. https://doi.org/10.1145/3539597.3570443

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free