An approximate dynamic programming method for multi‐input multi‐output nonlinear system
- 15 December 2011
- journal article
- research article
- Published by Wiley in Optimal Control Applications and Methods
- Vol. 34 (1) , 80-95
Abstract
SUMMARY: Approximate dynamic programming is a useful tool in solving multi‐stage decision optimal control problems. In this work, we first promote the action‐dependent heuristic dynamic programming method to multi‐input multi‐output control system by extending its action network to multi‐output form. The detailed derivation is also given. We then apply this method to the fluctuation control of a spark engine idle speed. An engine idling model is set up to verify the control effect of this method. Results here show that this method requires several iterations to suppress unbalanced combustion by manipulating spark ignition timing. This method provides an alternative for a simpler multi‐input multi‐output approximate dynamic programming scheme. Moreover, it has a faster iteration convergence effect. The derivation of this method also has a rigorous mathematical basis. Although illustrated for engines, this control system framework should also be applicable to general multi‐input multi‐output nonlinear system. Copyright © 2011 John Wiley & Sons, Ltd.Keywords
This publication has 25 references indexed in Scilit:
- Adaptive Dynamic Programming: An IntroductionIEEE Computational Intelligence Magazine, 2009
- Adaptive Critic Learning Techniques for Engine Torque and Air–Fuel Ratio ControlIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Approximate Dynamic Programming2007
- Online Adaptive Critic Flight ControlJournal of Guidance, Control, and Dynamics, 2004
- Power Systems Stability Control: Reinforcement Learning FrameworkIEEE Transactions on Power Systems, 2004
- Handbook of Learning and Approximate Dynamic Programming2004
- Helicopter trimming and tracking control using direct neural dynamic programmingIEEE Transactions on Neural Networks, 2003
- Intelligent engine control using an adaptive criticIEEE Transactions on Control Systems Technology, 2003
- Adaptive critic designsIEEE Transactions on Neural Networks, 1997
- Practical issues in temporal difference learningMachine Learning, 1992