Predicting human decisions with behavioural theories and machine learning
Top Cited Papers
- 21 July 2025
- journal article
- research article
- Published by Springer Nature in Nature Human Behaviour
- Vol. 9 (11) , 2271-2284
Abstract
Predicting human decisions under risk and uncertainty remains a fundamental challenge across disciplines. Existing models often struggle even in highly stylized tasks like choice between lotteries. Here we introduce BEAST gradient boosting (BEAST-GB), a hybrid model integrating behavioural theory (BEAST) with machine learning. We first present CPC18, a competition for predicting risky choice, in which BEAST-GB won. Then, using two large datasets, we demonstrate that BEAST-GB predicts more accurately than neural networks trained on extensive data and dozens of existing behavioural models. BEAST-GB also generalizes robustly across unseen experimental contexts, surpassing direct empirical generalization, and helps to refine and improve the behavioural theory itself. Our analyses highlight the potential of anchoring predictions on behavioural theory even in data-rich settings and even when the theory alone falters. Our results underscore how integrating machine learning with theoretical frameworks, especially those—like BEAST—designed for prediction, can improve our ability to predict and understand human behaviour.Keywords
All Related Versions
Funding Information
- EC | Horizon 2020 Framework Programme (740435)
- United States Department of Defense | Defense Advanced Research Projects Agency (D17AC00004, D17AC00004, D17AC00004, D17AC00004)
- National Science Foundation (1718550, 1718550, 1718550, 1718550)
- Israel Science Foundation (1821/12)
This publication has 49 references indexed in Scilit:
- The Relative Importance of the Contrast and Assimilation Effects in Decisions Under RiskJournal of Behavioral Decision Making, 2024
- The elusiveness of context effects in decision makingTrends in Cognitive Sciences, 2021
- Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguityJournal of Economic Behavior & Organization, 2017
- Eye Movements in Risky ChoiceJournal of Behavioral Decision Making, 2015
- Decision by samplingCognitive Psychology, 2006
- Learning in One-Shot Strategic Form Games2006
- It is Whether You Win or Lose: The Importance of the Overall Probabilities of Winning or Losing in Risky ChoiceJournal of Risk and Uncertainty, 2005
- Small feedback‐based decisions and their limited correspondence to description‐based decisionsJournal of Behavioral Decision Making, 2003
- Advances in prospect theory: Cumulative representation of uncertaintyJournal of Risk and Uncertainty, 1992
- Expert measurement and mechanical combinationOrganizational Behavior and Human Performance, 1972