Bengali Fake Reviews: A Benchmark Dataset and Detection System
Preprint
Abstract
The proliferation of fake reviews on various online platforms has created a major concern for both consumers and businesses. Such reviews can deceive customers and cause damage to the reputation of products or services, making it crucial to identify them. Although the detection of fake reviews has been extensively studied in English language, detecting fake reviews in non-English languages such as Bengali is still a relatively unexplored research area. This paper introduces the Bengali Fake Review Detection (BFRD) dataset, the first publicly available dataset for identifying fake reviews in Bengali. The dataset consists of 7710 non-fake and 1339 fake food-related reviews collected from social media posts. To convert non-Bengali words in a review, a unique pipeline has been proposed that translates English words to their corresponding Bengali meaning and also back transliterates Romanized Bengali to Bengali. We have conducted rigorous experimentation using multiple deep learning and pre-trained transformer language models to develop a reliable detection system. Finally, we propose a weighted ensemble model that combines four pre-trained transformers: BanglaBERT, BanglaBERT Base, BanglaBERT Large, and BanglaBERT Generator . According to the experiment results, the proposed ensemble model obtained a weighted F1-score of 0.9843 on 13390 reviews, including 1339 actual fake reviews and 5356 augmented fake reviews generated with the nlpaug library. The remaining 6695 reviews were randomly selected from the 7710 non-fake instances. The model achieved a 0.9558 weighted F1-score when the fake reviews were augmented using the bnaug library.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Tackling cyber-aggression: Identification and fine-grained categorization of aggressive texts on social media using weighted ensemble of transformersNeurocomputing, 2022
- Creating and detecting fake reviews of online productsJournal of Retailing and Consumer Services, 2022
- A review on social spam detection: Challenges, open issues, and future directionsExpert Systems with Applications, 2021
- Analysis of concept drift in fake reviews detectionExpert Systems with Applications, 2021
- Fake reviews classification using deep learning ensemble of shallow convolutionsJournal of Computational Social Science, 2021
- Incorporating feature representation into BiLSTM for deceptive review detectionComputing, 2019
- DRI-RCNN: An approach to deceptive review identification using recurrent convolutional neural networkInformation Processing & Management, 2018
- Cross-domain deception detection using support vector networksSoft Computing, 2016
- Do online reviews matter? — An empirical investigation of panel dataDecision Support Systems, 2008
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005