Intrinsic Rewards for Maintenance, Approach, Avoidance, and Achievement Goal Types
Open Access
- 9 October 2018
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neurorobotics
- Vol. 12, 63
Abstract
In reinforcement learning, reward is used to guide the learning process. The reward is often designed to be task-dependent, and it may require significant domain knowledge to design a good reward function. This paper proposes general reward functions for maintenance, approach, avoidance, and achievement goal types. These reward functions exploit the inherent property of each type of goal and are thus task-independent. We also propose metrics to measure an agent's performance for learning each type of goal. We evaluate the intrinsic reward functions in a framework that can autonomously generate goals and learn solutions to those goals using a standard reinforcement learning algorithm. We show empirically how the proposed reward functions lead to learning in a mobile robot application. Finally, using the proposed reward functions as building blocks, we demonstrate how compound reward functions, reward functions to generate sequences of tasks, can be created that allow the mobile robot to learn more complex behaviors.Keywords
This publication has 16 references indexed in Scilit:
- Summary for Policymakers2014
- Novelty or Surprise?Frontiers in Psychology, 2013
- Novelty Detection as an Intrinsic Motivation for Cumulative Learning Robots2012
- Functions and Mechanisms of Intrinsic Motivations2012
- Opportunistic Motivated Learning Agents2012
- What is intrinsic motivation? A typology of computational approachesFrontiers in Neurorobotics, 2007
- On proactivity and maintenance goals2006
- Goal Representation for BDI Agent SystemsLecture Notes in Computer Science, 2005
- Autonomous Mental Development by Robots and AnimalsScience, 2001
- Lifelong robot learningRobotics and Autonomous Systems, 1995