Effects of Soft-Domain Transfer and Named Entity Information on Deception Detection
Preprint
Abstract
In the modern age an enormous amount of communication occurs online, and it is difficult to know when something written is genuine or deceitful. There are many reasons for someone to deceive online (e.g., monetary gain, political gain) and detecting this behavior without any physical interaction is a difficult task. Additionally, deception occurs in several text-only domains and it is unclear if these various sources can be leveraged to improve detection. To address this, eight datasets were utilized from various domains to evaluate their effect on classifier performance when combined with transfer learning via intermediate layer concatenation of fine-tuned BERT models. We find improvements in accuracy over the baseline. Furthermore, we evaluate multiple distance measurements between datasets and find that Jensen-Shannon distance correlates moderately with transfer learning performance. Finally, the impact was evaluated of multiple methods, which produce additional information in a dataset's text via named entities, on BERT performance and we find notable improvement in accuracy of up to 11.2%.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Entity-centric multi-domain transformer for improving generalization in fake news detectionInformation Processing & Management, 2024
- Exploring groups of opinion spam using sentiment analysis guided by nominated topicsExpert Systems with Applications, 2021
- Detecting Fake Reviews Using Multidimensional Representations With Fine-Grained Aspects PlanIEEE Access, 2020
- Sentimental LIAR: Extended Corpus and Deep Learning Models for Fake Claim Classification2020
- A review of research on detection of fake commodity reviewsJournal of Physics: Conference Series, 2020
- An In-Depth Benchmarking and Evaluation of Phishing Detection Research for Security NeedsIEEE Access, 2020
- DCWord: A Novel Deep Learning Approach to Deceptive Review Identification by Word VectorsJournal of Systems Science and Systems Engineering, 2019
- DRI-RCNN: An approach to deceptive review identification using recurrent convolutional neural networkInformation Processing & Management, 2018
- Interpersonal deception: III. Effects of deceit on perceived communication and nonverbal behavior dynamicsJournal of Nonverbal Behavior, 1994
- Divergence measures based on the Shannon entropyIEEE Transactions on Information Theory, 1991