Abstract
Immediate rewards are usually very sparse in the real world, which brings a great challenge to plain learning methods. Inspired by the fact that emotional reactions are incorporated into the computation of subjective value during decision-making in humans, an emotion-motivated decision-making framework is proposed in this paper. Specifically, we firstly build a brain-inspired computational model of amygdala-hippocampus interaction to generate emotional reactions. The intrinsic emotion derives from the external reward and episodic memory, and represents three psychological states: valence, novelty and motivational relevance. Then, a model-based decision-making approach with emotional intrinsic rewards is proposed to solve the continuous control problem of mobile robots. This method can execute online model-based control with the constraint of the model-free policy and global value function, which is conducive to getting a better solution with a faster policy search. The simulation results demonstrate that the proposed approach has higher learning efficiency and maintains a higher level of exploration, especially in some very sparse-reward environments.
Funding Information
  • National Key Research and Development Program of China (2017YFB1300200, 2017YFB1300203)
  • National Natural Science Foundation of China (91648205, 61627808, 61702516)
  • Strategic Priority Research Program of Chinese Academy of Science (XDB32050100)
  • Development of Science and Technology of Guangdong Province Special Fund Project (2016B090910001)

This publication has 40 references indexed in Scilit: