Urszula Walińska at SemEval-2020 Task 8: Fusion of text and image features using LSTM and VGG16 for Memotion Analysis

Abstract

In the paper, we describe the Urszula Walińska's entry to the SemEval-2020 Task 8: Memotion Analysis. The sentiment analysis of memes task, is motivated by a pervasive problem of offensive content spread in social media up to the present time. In fact, memes are an important medium of expressing opinion and emotions, therefore they can be hateful at many times. In order to identify emotions expressed by memes we construct a tool based on neural networks and deep learning methods. It takes an advantage of a multi-modal nature of the task and performs fusion of image and text features extracted by models dedicated to this task. Our solution achieved 0.346 macro F1-score in Task A - Sentiment Classification, which brought us to the 7th place in the official rank of the competition.