Fine-Tuning BERT Models to Classify Misinformation on Garlic and COVID-19 on Twitteropen access
- Authors
- Kim, Myeong Gyu; Kim, Minjung; Kim, Jae Hyun; Kim, Kyungim
- Issue Date
- 5월-2022
- Publisher
- MDPI
- Keywords
- bidirectional encoder representations from transformers (BERT); COVID-19; garlic; misinformation; Twitter
- Citation
- INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, v.19, no.9
- Indexed
- SCIE
SSCI
SCOPUS
- Journal Title
- INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH
- Volume
- 19
- Number
- 9
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/141775
- DOI
- 10.3390/ijerph19095126
- ISSN
- 1661-7827
- Abstract
- Garlic-related misinformation is prevalent whenever a virus outbreak occurs. With the outbreak of COVID-19, garlic-related misinformation is spreading through social media, including Twitter. Bidirectional Encoder Representations from Transformers (BERT) can be used to classify misinformation from a vast number of tweets. This study aimed to apply the BERT model for classifying misinformation on garlic and COVID-19 on Twitter, using 5929 original tweets mentioning garlic and COVID-19 (4151 for fine-tuning, 1778 for test). Tweets were manually labeled as 'misinformation' and 'other.' We fine-tuned five BERT models (BERTBASE, BERTLARGE, BERTweet-base, BERTweet-COVID-19, and BERTweet-large) using a general COVID-19 rumor dataset or a garlic-specific dataset. Accuracy and F1 score were calculated to evaluate the performance of the models. The BERT models fine-tuned with the COVID-19 rumor dataset showed poor performance, with maximum accuracy of 0.647. BERT models fine-tuned with the garlic-specific dataset showed better performance. BERTweet models achieved accuracy of 0.897-0.911, while BERTBASE and BERTLARGE achieved accuracy of 0.887-0.897. BERTweet-large showed the best performance with maximum accuracy of 0.911 and an F1 score of 0.894. Thus, BERT models showed good performance in classifying misinformation. The results of our study will help detect misinformation related to garlic and COVID-19 on Twitter.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Pharmacy > Department of Pharmaceutical Science > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.