Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
Open Access
- 26 September 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-12
Abstract
High-quality AI-generated portraits (“deepfakes”) are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants’ (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (AB277/6, under Germany’s Excellence Strategy – EXC 2002/1 “Science of Intelligence” – project number 390523135, AB277/6)
- Humboldt-Universität zu Berlin
This publication has 51 references indexed in Scilit:
- Faces in Context: A Review and Systematization of Contextual Influences on Affective Face ProcessingFrontiers in Psychology, 2012
- Presentation and validation of the Radboud Faces DatabaseCognition and Emotion, 2010
- FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validationBehavior Research Methods, 2010
- Early and late temporo-spatial effects of contextual interference during perception of facial affectInternational Journal of Psychophysiology, 2009
- Emotion and attention in visual word processing—An ERP studyBiological Psychology, 2009
- Mixed-effects modeling with crossed random effects for subjects and itemsJournal of Memory and Language, 2008
- The Facilitated Processing of Threatening Faces: An ERP Analysis.Emotion, 2004
- Neuromagnetic Correlates of Perceived Contrast in Primary Visual CortexJournal of Neurophysiology, 2003
- Fears, phobias, and preparedness: Toward an evolved module of fear and fear learning.Psychological Review, 2001
- Electrophysiological Studies of Face Perception in HumansJournal of Cognitive Neuroscience, 1996