CH-SIMS: A Chinese multimodal sentiment analysis dataset with fine-grained annotations of modality

260Citations
Citations of this article
232Readers
Mendeley users who have this article in their library.

Abstract

Previous studies in multimodal sentiment analysis have used limited datasets, which only contain unified multimodal annotations. However, the unified annotations do not always reflect the independent sentiment of single modalities and limit the model to capture the difference between modalities. In this paper, we introduce a Chinese single- and multimodal sentiment analysis dataset, CH-SIMS, which contains 2,281 refined video segments in the wild with both multimodal and independent unimodal annotations. It allows researchers to study the interaction between modalities or use independent unimodal annotations for unimodal sentiment analysis. Furthermore, we propose a multi-task learning framework based on late fusion as the baseline. Extensive experiments on the CH-SIMS show that our methods achieve state-of-the-art performance and learn more distinctive unimodal representations. The full dataset and codes are available for use at https://github.com/thuiar/MMSA.

Cite

CITATION STYLE

APA

Yu, W., Xu, H., Meng, F., Zhu, Y., Ma, Y., Wu, J., … Yang, K. (2020). CH-SIMS: A Chinese multimodal sentiment analysis dataset with fine-grained annotations of modality. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (pp. 3718–3727). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2020.acl-main.343

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free