Boredom-Driven Curious Learning by Homeo-Heterostatic Value Gradients
Open Access
- 22 January 2019
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurorobotics
- Vol. 12, 88
Abstract
This paper presents the Homeo-Heterostatic Value Gradients (HHVG) algorithm as a formal account on the constructive interplay between boredom and curiosity which gives rise to effective exploration and superior forward model learning. We envisaged actions as instrumental in agent's own epistemic disclosure. This motivated two central algorithmic ingredients: devaluation and devaluation progress, both underpin agent's cognition concerning intrinsically generated rewards. The two serve as an instantiation of homeostatic and heterostatic intrinsic motivation. A key insight from our algorithm is that the two seemingly opposite motivations can be reconciled---without which exploration and information-gathering cannot be effectively carried out. We supported this claim with empirical evidence, showing that boredom-enabled agents consistently outperformed other curious or explorative agent variants in model building benchmarks based on self-assisted experience accumulation.Keywords
All Related Versions
Funding Information
- Japan Science and Technology Agency (JPMJCR15E2)
This publication has 39 references indexed in Scilit:
- On the Function of BoredomBehavioral Sciences, 2013
- The Unengaged MindPerspectives on Psychological Science, 2012
- Free-Energy Minimization and the Dark-Room ProblemFrontiers in Psychology, 2012
- The Definition, Assessment, and Mitigation of State Boredom Within Educational Settings: A Comprehensive ReviewEducational Psychology Review, 2011
- Does a Lack of Life Meaning Cause Boredom? Results from Psychometric, Longitudinal, and Experimental AnalysesJournal of Social and Clinical Psychology, 2009
- Psychophysiological investigation of vigilance decrement: Boredom or cognitive fatigue?Physiology & Behavior, 2008
- What is intrinsic motivation? A typology of computational approachesFrontiers in Neurorobotics, 2007
- Sensation seeking in England and America: Cross-cultural, age, and sex comparisons.Journal of Consulting and Clinical Psychology, 1978
- Increase of autonomic arousal by boredom.Journal of Abnormal Psychology, 1972
- Structure of boredom.Journal of Personality and Social Psychology, 1966