Back to Search Start Over

A Fine-Tuned BERT-Based Transfer Learning Approach for Text Classification.

Authors :
Qasim, Rukhma
Bangyal, Waqas Haider
Alqarni, Mohammed A.
Ali Almazroi, Abdulwahab
Source :
Journal of Healthcare Engineering; 1/7/2022, p1-17, 17p
Publication Year :
2022

Abstract

Text Classification problem has been thoroughly studied in information retrieval problems and data mining tasks. It is beneficial in multiple tasks including medical diagnose health and care department, targeted marketing, entertainment industry, and group filtering processes. A recent innovation in both data mining and natural language processing gained the attention of researchers from all over the world to develop automated systems for text classification. NLP allows categorizing documents containing different texts. A huge amount of data is generated on social media sites through social media users. Three datasets have been used for experimental purposes including the COVID-19 fake news dataset, COVID-19 English tweet dataset, and extremist-non-extremist dataset which contain news blogs, posts, and tweets related to coronavirus and hate speech. Transfer learning approaches do not experiment on COVID-19 fake news and extremist-non-extremist datasets. Therefore, the proposed work applied transfer learning classification models on both these datasets to check the performance of transfer learning models. Models are trained and evaluated on the accuracy, precision, recall, and F1-score. Heat maps are also generated for every model. In the end, future directions are proposed. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
20402295
Database :
Complementary Index
Journal :
Journal of Healthcare Engineering
Publication Type :
Academic Journal
Accession number :
154557528
Full Text :
https://doi.org/10.1155/2022/3498123