Disturbance modifies payoffs in the explore-exploit trade-off
Open Access
- 29 July 2019
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 10 (1) , 1-9
Abstract
Decision-making agents face a fundamental trade-off between exploring new opportunities with risky outcomes versus exploiting familiar options with more certain but potentially suboptimal outcomes. Although mediation of this trade-off is essential to adaptive behavior and has for decades been assumed to modulate performance, the empirical consequences of human exploratory strategies are unknown beyond laboratory or theoretical settings. Leveraging 540,000 vessel position records from 2494 commercial fishing trips along with corresponding revenues, here we find that during undisturbed conditions, there was no relationship between exploration and performance, contrary to theoretical predictions. However, during a major disturbance event which closed the most-utilized fishing grounds, explorers benefited significantly from less-impacted revenues and were also more likely to continue fishing. We conclude that in stochastic natural systems characterized by non-stationary rewards, the role of exploration in buffering against disturbance may be greater than previously thought in humans.Keywords
This publication has 39 references indexed in Scilit:
- marmap: A Package for Importing, Plotting and Analyzing Bathymetric and Topographic Data in RPLOS ONE, 2013
- Limits of Predictability in Human MobilityScience, 2010
- Temporal and spatial changes in social vulnerability to natural hazardsProceedings of the National Academy of Sciences, 2008
- Should I stay or should I go? How the human brain manages the trade-off between exploitation and explorationPhilosophical Transactions of the Royal Society B: Biological Sciences, 2007
- Cortical substrates for exploratory decisions in humansNature, 2006
- Behavioral syndromes: an ecological and evolutionary overviewTrends in Ecology & Evolution, 2004
- Consistent individual differences in early exploratory behaviour of male great titsAnimal Behaviour, 1994
- Restless bandits: activity allocation in a changing worldJournal of Applied Probability, 1988
- Dynamics of Discovery and Exploitation: The Case of the Scotian Shelf Groundfish FisheriesCanadian Journal of Fisheries and Aquatic Sciences, 1986
- A dynamic allocation index for the discounted multiarmed bandit problemBiometrika, 1979