Multimodal Deep Learning for Social Media Popularity Prediction with Attention Mechanism

30Citations
Citations of this article
17Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Social media popularity estimation refers to predict the post's popularity using multimodal contents. The prediction performance heavily relies on the feature extraction part and fully leveraging multimodal heterogeneous data is of a great challenge in the practical settings. Despite remarkable progress have been made, most of the previous attempts are restrained from the essentially limited property of the employed single modality. Inspired by the recent success of multimodal learning, we propose a novel multimodal deep learning framework for the popularity prediction task, which aims to leverage the complementary knowledge from different modalities. Moreover, an attention mechanism is introduced in our framework, with the goal to assign large weights to specified modalities during the training and inference phases. To empirically investigate the effectiveness and robustness of the proposed approach, we conduct extensive experiments on the 2020 SMP challenge. The obtained results show that the proposed framework outperforms related approaches.

Cite

CITATION STYLE

APA

Xu, K., Lin, Z., Zhao, J., Shi, P., Deng, W., & Wang, H. (2020). Multimodal Deep Learning for Social Media Popularity Prediction with Attention Mechanism. In MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia (pp. 4580–4584). Association for Computing Machinery, Inc. https://doi.org/10.1145/3394171.3416274

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free