Task-distribution-aware Meta-learning for Cold-start CTR Prediction

7Citations
Citations of this article
17Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Nowadays, click-through rate (CTR) prediction has achieved great success in online advertising. However, making desirable predictions for unseen ads is still challenging, which is known as the cold-start problem. To address such a problem in CTR prediction, meta-learning methods have recently emerged as a popular direction. In these approaches, the predictions for each user/item are regarded as individual tasks, then training a meta-learner on them to implement zero-shot/few-shot learning for unknown tasks. Though these approaches have effectively alleviated the cold-start problem, two facts are not paid enough attention, 1) the diversity of the task difficulty and 2) the perturbation of the task distribution. In this paper, we propose an adaptive loss that ensures the consistency between the task weight and difficulty. Interestingly, the loss function can also be viewed as a description of the worst-case performance under distribution perturbation. Moreover, we develop an algorithm, under the framework of gradient descent with max-oracle (GDmax), to minimize such an adaptive loss. Then we prove the algorithm can return to a stationary point of the adaptive loss. Finally, we implement our method on top of the meta-embedding framework and conduct experiments on three real-world datasets. The experiments show that our proposed method significantly improves the predictions in the cold-start scenario.

Cite

CITATION STYLE

APA

Cao, T., Xu, Q., Yang, Z., & Huang, Q. (2020). Task-distribution-aware Meta-learning for Cold-start CTR Prediction. In MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia (pp. 3514–3522). Association for Computing Machinery, Inc. https://doi.org/10.1145/3394171.3413739

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free