Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets

1Citations
Citations of this article
50Readers
Mendeley users who have this article in their library.
Get full text

Abstract

We describe our straight-forward approach for Tasks 5 and 6 of 2021 Social Media Mining for Health Applications (SMM4H) shared tasks. Our system is based on fine-tuning DistillBERT on each task, as well as first fine-tuning the model on the other task. We explore how much fine-tuning is necessary for accurately classifying tweets as containing self-reported COVID-19 symptoms (Task 5) or whether a tweet related to COVID-19 is self-reporting, non-personal reporting, or a literature/news mention of the virus (Task 6).

Cite

CITATION STYLE

APA

Fleming, M., Dondeti, P., Dreisbach, C. N., & Poliak, A. (2021). Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets. In Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks (pp. 131–134). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2021.smm4h-1.28

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free