Self-motivated learning of achievement and maintenance tasks for non-player characters in computer games
Authors:
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
This paper presents a framework for motivated reinforcement learning agents that can identify and solve either achievement or maintenance tasks. To evaluate and compare agents using these approaches, we also introduce two new metrics to better characterise and differentiate the behaviour of characters motivated to learn different kinds of tasks. These metrics quantify the focus of attention and dwell time of agents. We perform an empirical evaluation of motivated reinforcement learning agents controlling characters in a simulated game scenario, comparing the effect of three different motivations for learning achievement and maintenance tasks. Results show that we can generate characters with quantifiably different achievement and maintenance oriented behaviour using our proposed task identification approach. Of the three motivations studied - novelty, interest and competence - novelty-seeking motivation is the most effective for creating agents with distinctive maintenance or achievement oriented behaviours.Keywords
This publication has 10 references indexed in Scilit:
- Intrinsic Motivation and Reinforcement Learning2012
- Intrinsic Motivation and Introspection in Reinforcement LearningIEEE Transactions on Autonomous Mental Development, 2012
- Modeling Behavior Cycles as a Value System for Developmental RobotsAdaptive Behavior, 2010
- A Comparative Study of Value Systems for Self-Motivated Exploration and Learning by RobotsIEEE Transactions on Autonomous Mental Development, 2010
- Intrinsically Motivated Reinforcement Learning: An Evolutionary PerspectiveIEEE Transactions on Autonomous Mental Development, 2010
- Motivated Reinforcement Learning2009
- On-line novelty detection for autonomous mobile robotsRobotics and Autonomous Systems, 2005
- Autonomous Mental Development by Robots and AnimalsScience, 2001
- Intentional agents and goal formation1998
- Computer simulation of a model of habituationNature, 1976