A Multitask Framework for Sentiment, Emotion and Sarcasm aware Cyberbullying Detection from Multi-modal Code-Mixed Memes

44Citations
Citations of this article
59Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Detecting cyberbullying from memes is highly challenging, because of the presence of the implicit affective content which is also often sarcastic, and multi-modality (image + text). The current work is the first attempt, to the best of our knowledge, in investigating the role of sentiment, emotion and sarcasm in identifying cyberbullying from multi-modal memes in a code-mixed language setting. As a contribution, we have created a benchmark multi-modal meme dataset called MultiBully annotated with bully, sentiment, emotion and sarcasm labels collected from open-source Twitter and Reddit platforms. Moreover, the severity of the cyberbullying posts is also investigated by adding a harmfulness score to each of the memes. The created dataset consists of two modalities, text and image. Most of the texts in our dataset are in code-mixed form, which captures the seamless transitions between languages for multilingual users. Two different multimodal multitask frameworks (BERT+ResNET-Feedback and CLIP-CentralNet) have been proposed for cyberbullying detection (CD), the three auxiliary tasks being sentiment analysis (SA), emotion recognition (ER) and sarcasm detection (SAR). Experimental results indicate that compared to uni-modal and single-task variants, the proposed frameworks improve the performance of the main task, i.e., CD, by 3.18% and 3.10% in terms of accuracy and F1 score, respectively.

References Powered by Scopus

Deep residual learning for image recognition

174356Citations
N/AReaders
Get full text

Measuring nominal scale agreement among many raters

6541Citations
N/AReaders
Get full text

Multitask Learning

5565Citations
N/AReaders
Get full text

Cited by Powered by Scopus

KnowleNet: Knowledge fusion network for multimodal sarcasm detection

62Citations
N/AReaders
Get full text

Sarcasm driven by sentiment: A sentiment-aware hierarchical fusion network for multimodal sarcasm detection

15Citations
N/AReaders
Get full text

Fact-sentiment incongruity combination network for multimodal sarcasm detection

12Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Maity, K., Jha, P., Saha, S., & Bhattacharyya, P. (2022). A Multitask Framework for Sentiment, Emotion and Sarcasm aware Cyberbullying Detection from Multi-modal Code-Mixed Memes. In SIGIR 2022 - Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1739–1749). Association for Computing Machinery, Inc. https://doi.org/10.1145/3477495.3531925

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 6

40%

Lecturer / Post doc 4

27%

Researcher 3

20%

Professor / Associate Prof. 2

13%

Readers' Discipline

Tooltip

Computer Science 12

75%

Engineering 2

13%

Social Sciences 1

6%

Sports and Recreations 1

6%

Save time finding and organizing research with Mendeley

Sign up for free