AI Pontryagin or how artificial neural networks learn to control dynamical systems
Open Access
- 17 January 2022
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 13 (1) , 1-9
Abstract
The efficient control of complex dynamical systems has many applications in the natural and applied sciences. In most real-world control problems, both control energy and cost constraints play a significant role. Although such optimal control problems can be formulated within the framework of variational calculus, their solution for complex systems is often analytically and computationally intractable. To overcome this outstanding challenge, we present AI Pontryagin, a versatile control framework based on neural ordinary differential equations that automatically learns control signals that steer high-dimensional dynamical systems towards a desired target state within a specified time interval. We demonstrate the ability of AI Pontryagin to learn control signals that closely resemble those found by corresponding optimal control frameworks in terms of control energy and deviation from the desired target state. Our results suggest that AI Pontryagin is capable of solving a wide range of control and optimization problems, including those that are analytically intractable.Keywords
This publication has 36 references indexed in Scilit:
- Evolution of Controllability in Interbank NetworksScientific Reports, 2013
- Nodal Dynamics, Not Degree Distributions, Determine the Structural Controllability of Complex NetworksPLOS ONE, 2012
- Controllability of complex networksNature, 2011
- Self-organized adaptation of a simple neural circuit enables complex robot behaviourNature Physics, 2010
- Continuous quantum error correction as classical hybrid controlNew Journal of Physics, 2009
- Phenomenological models of socioeconomic network dynamicsPhysical Review E, 2006
- Maximum principle, dynamic programming, and their connection in deterministic controlJournal of Optimization Theory and Applications, 1990
- Nonsmooth solutions of Hamilton-Jacobi-Bellman equation1988
- A family of embedded Runge-Kutta formulaeJournal of Computational and Applied Mathematics, 1980
- Structural controllabilityIEEE Transactions on Automatic Control, 1974