Computational Modeling of Emotion-Motivated Decisions for Continuous Control of Mobile Robots
- 1 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. 13 (1) , 31-44
Abstract
Immediate rewards are usually very sparse in the real world, which brings a great challenge to plain learning methods. Inspired by the fact that emotional reactions are incorporated into the computation of subjective value during decision-making in humans, an emotion-motivated decision-making framework is proposed in this paper. Specifically, we firstly build a brain-inspired computational model of amygdala-hippocampus interaction to generate emotional reactions. The intrinsic emotion derives from the external reward and episodic memory, and represents three psychological states: valence, novelty and motivational relevance. Then, a model-based decision-making approach with emotional intrinsic rewards is proposed to solve the continuous control problem of mobile robots. This method can execute online model-based control with the constraint of the model-free policy and global value function, which is conducive to getting a better solution with a faster policy search. The simulation results demonstrate that the proposed approach has higher learning efficiency and maintains a higher level of exploration, especially in some very sparse-reward environments.Keywords
Funding Information
- National Key Research and Development Program of China (2017YFB1300200, 2017YFB1300203)
- National Natural Science Foundation of China (91648205, 61627808, 61702516)
- Strategic Priority Research Program of Chinese Academy of Science (XDB32050100)
- Development of Science and Technology of Guangdong Province Special Fund Project (2016B090910001)
This publication has 40 references indexed in Scilit:
- Anatomy and computational modeling of networks underlying cognitive-emotional interactionFrontiers in Human Neuroscience, 2013
- Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategiesFrontiers in Behavioral Neuroscience, 2012
- Neural correlates of emotion processing: From emotional to social brainEuropean Neuropsychopharmacology, 2012
- Dissociable Roles of Prelimbic and Infralimbic Cortices, Ventral Hippocampus, and Basolateral Amygdala in the Expression and Extinction of Conditioned FearNeuropsychopharmacology, 2010
- Emotion and autobiographical memoryPhysics of Life Reviews, 2010
- Motivational states activate distinct hippocampal representations to guide goal-directed behaviorsProceedings of the National Academy of Sciences, 2009
- Stress Prompts Habit Behavior in HumansThe Journal of Neuroscience, 2009
- Stress signalling pathways that impair prefrontal cortex structure and functionNature Reviews Neuroscience, 2009
- The Neural Bases of Emotion Regulation: Reappraisal and Suppression of Negative EmotionBiological Psychiatry, 2008
- On the production and release of chemical transmitters and related topics in cellular controlJournal of Theoretical Biology, 1969