UNIDECOR: A Unified Deception Corpus for Cross-Corpus Deception Detection
Preprint
Abstract
Verbal deception has been studied in psychology, forensics, and computational linguistics for a variety of reasons, like understanding behaviour patterns, identifying false testimonies, and detecting deception in online communication. Varying motivations across research fields lead to differences in the domain choices to study and in the conceptualization of deception, making it hard to compare models and build robust deception detection systems for a given language. With this paper, we improve this situation by surveying available English deception datasets which include domains like social media reviews, court testimonials, opinion statements on specific topics, and deceptive dialogues from online strategy games. We consolidate these datasets into a single unified corpus. Based on this resource, we conduct a correlation analysis of linguistic cues of deception across datasets to understand the differences and perform cross-corpus modeling experiments which show that a cross-domain generalization is challenging to achieve. The unified deception corpus (UNIDECOR) can be obtained from https://www.ims.uni-stuttgart.de/data/unidecor.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Corpus similarity measures remain robust across diverse languagesLingua, 2022
- Fake opinion detection: how similar are crowdsourced datasets to real data?Language Resources and Evaluation, 2020
- Cross-domain deception detection using support vector networksSoft Computing, 2016
- Automatic deception detection: Methods for finding fake newsProceedings of the Association for Information Science and Technology, 2015
- The linguistic correlates of conversational deception: Comparing natural language processing technologiesApplied Psycholinguistics, 2010
- Language of lies in prison: linguistic classification of prisoners' truthful and deceptive natural languageApplied Cognitive Psychology, 2005
- Discerning lies from truths: behavioural cues to deception and the indirect pathway of intuition2004
- Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated CommunicationsGroup Decision and Negotiation, 2004
- Cues to deception.Psychological Bulletin, 2003
- Verbal and Nonverbal Communication of Deception1981