Where Computation and Dynamics Meet: Heteroclinic Network-Based Controllers in Evolutionary Robotics
- 18 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 31 (4) , 1084-1097
Abstract
In the fields of artificial neural networks and robotics, complicated, often high-dimensional systems can be designed using evolutionary/other algorithms to successfully solve very complex tasks. However, dynamical analysis of the underlying controller can often be near impossible, due to the high dimension and nonlinearities in the system. In this paper, we propose a more restricted form of controller, such that the underlying dynamical systems are forced to contain a dynamical object called a heteroclinic network. Systems containing heteroclinic networks share some properties with finite-state machines (FSMs) but are not discrete: both space and time are still described with continuous variables. Thus, we suggest that the heteroclinic networks can provide a hybrid between continuous and discrete systems. We investigate this innovated architecture in a minimal categorical perception task. The similarity of the controller to an FSM allows us to describe some of the system's behaviors as transition between states. However, other, essential behavior involves subtle ongoing interaction between the controller and the environment that eludes description at this level.Keywords
Funding Information
- External Fellowship of the London Mathematical Laboratory awarded to C. M. Postlethwaite
- Royal Society
This publication has 44 references indexed in Scilit:
- A Dynamical Systems Account of Sensorimotor ContingenciesFrontiers in Psychology, 2013
- Associative Learning on a Continuum in Evolved Dynamical Neural NetworksAdaptive Behavior, 2008
- Spinal control of locomotion – from cat to manActa Physiologica, 2007
- Dynamical principles in neuroscienceReviews of Modern Physics, 2006
- Automatic Generation of Controllers for Embodied Legged Organisms: A Pareto Evolutionary Multi-Objective ApproachEvolutionary Computation, 2004
- Infinities of stable periodic orbits in systems of coupled oscillatorsPhysical Review E, 2002
- The dynamics of adaptive behavior: A research programRobotics and Autonomous Systems, 1997
- Structurally stable heteroclinic cyclesMathematical Proceedings of the Cambridge Philosophical Society, 1988
- Convection in a Rotating Layer: A Simple Case of TurbulenceScience, 1980
- Transition from laminar convection to thermal turbulence in a rotating fluid layerJournal of Fluid Mechanics, 1969