Turing Jest: Distributional Semantics and One‐Line Jokes
Open Access
- 21 May 2025
- journal article
- Published by Wiley in Cognitive Science
- Vol. 49 (5) , e70066
Abstract
Humor is an essential aspect of human experience, yet surprisingly, little is known about how we recognize and understand humorous utterances. Most theories of humor emphasize the role of incongruity detection and resolution (e.g., frame‐shifting), as well as cognitive capacities like Theory of Mind and pragmatic reasoning. In multiple preregistered experiments, we ask whether and to what extent exposure to purely linguistic input can account for the human ability to recognize one‐line jokes and identify their entailments. We find that GPT‐3, a large language model (LLM) trained on only language data, exhibits above‐chance performance in tasks designed to test its ability to detect, appreciate, and comprehend jokes. In exploratory work, we also find above‐chance performance in humor detection and comprehension in several open‐source LLMs, such as Llama‐3 and Mixtral. Although all LLMs tested fall short of human performance, both humans and LLMs show a tendency to misclassify nonjokes with surprising endings as jokes. Results suggest that LLMs are remarkably adept at some tasks involving one‐line jokes, but reveal key limitations of distributional approaches to meaning.Keywords
This publication has 74 references indexed in Scilit:
- A Computational Model of Linguistic Humor in PunsCognitive Science, 2015
- Humour as emotion regulation: The differential consequences of negative versus positive humourCognition and Emotion, 2012
- The weirdest people in the world?Behavioral and Brain Sciences, 2010
- Finding comfort in a joke: Consolatory effects of humor through cognitive distraction.Emotion, 2009
- Humor Use in Romantic Relationships: The Effects of Relationship Satisfaction and Pleasant Versus Conflict SituationsThe Journal of Psychology, 2008
- Handedness, hemispheric asymmetries, and joke comprehensionCognitive Brain Research, 2004
- The origin of humorMedical Hypotheses, 2002
- Getting it: human event-related brain response to jokes in good and poor comprehendersNeuroscience Letters, 2001
- The Long-Term Marriage: Perceptions of Stability and SatisfactionThe International Journal of Aging and Human Development, 1990
- Laughter among Colleagues†Psychiatry, 1960