BERT Models for Arabic Text Classification: A Systematic Review
Open Access
- 4 June 2022
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (11) , 5720
Abstract
Bidirectional Encoder Representations from Transformers (BERT) has gained increasing attention from researchers and practitioners as it has proven to be an invaluable technique in natural languages processing. This is mainly due to its unique features, including its ability to predict words conditioned on both the left and the right context, and its ability to be pretrained using the plain text corpus that is enormously available on the web. As BERT gained more interest, more BERT models were introduced to support different languages, including Arabic. The current state of knowledge and practice in applying BERT models to Arabic text classification is limited. In an attempt to begin remedying this gap, this review synthesizes the different Arabic BERT models that have been applied to text classification. It investigates the differences between them and compares their performance. It also examines how effective they are compared to the original English BERT models. It concludes by offering insight into aspects that need further improvements and future work.Keywords
This publication has 50 references indexed in Scilit:
- A survey on sentiment analysis challengesJournal of King Saud University – Engineering Sciences, 2018
- Revisiting Unreasonable Effectiveness of Data in Deep Learning Era2017
- A comprehensive study of text classification algorithms2017
- Gray literature: An important resource in systematic reviewsJournal of Evidence-Based Medicine, 2017
- Unconstrained scene text and video text recognition for Arabic script2017
- Social emotion classification of short text via topic-level maximum entropy modelInformation & Management, 2016
- A methodology for systematic mapping in environmental sciencesEnvironmental Evidence, 2016
- Arabic Information Retrieval: Techniques, tools and challenges2011
- PRISMA StatementEpidemiology, 2011
- Challenges in Approaching Metasynthesis ResearchQualitative Health Research, 2007