Recurrent Neural Dynamics Models for Perturbed Nonstationary Quadratic Programs: A Control-Theoretical Perspective
- 15 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 33 (3) , 1216-1227
Abstract
Recent decades have witnessed a trend that control-theoretical techniques are widely leveraged in various areas, e.g., design and analysis of computational models. Computational methods can be modeled as a controller and searching the equilibrium point of a dynamical system is identical to solving an algebraic equation. Thus, absorbing mature technologies in control theory and integrating it with neural dynamics models can lead to new achievements. This work makes progress along this direction by applying control-theoretical techniques to construct new recurrent neural dynamics for manipulating a perturbed nonstationary quadratic program (QP) with time-varying parameters considered. Specifically, to break the limitations of existing continuous-time models in handling nonstationary problems, a discrete recurrent neural dynamics model is proposed to robustly deal with noise. This work shows how iterative computational methods for solving nonstationary QP can be revisited, designed, and analyzed in a control framework. A modified Newton iteration model and an improved gradient-based neural dynamics are established by referring to the superior structural technology of the presented recurrent neural dynamics, where the chief breakthrough is their excellent convergence and robustness over the traditional models. Numerical experiments are conducted to show the eminence of the proposed models in solving perturbed nonstationary QP.Keywords
Funding Information
- National Natural Science Foundation of China (61703189, 11561029, 61772493)
- Pioneer Hundred Talents Program of the Chinese Academy of Sciences
- National Key Research and Development Program of China (2017YFE0118900)
- Natural Science Foundation of Chongqing Municipality (cstc2019jcyjjqX0013, cstc2020jcyj-zdxmX0028)
- Research and Development Foundation of Nanchong (20YFZJ0018)
- CAS “Light of West China” Program
- Chongqing Key Laboratory of Mobile Communications Technology (cqupt-mct-202004)
- Ministry of Science and Higher Education of the Russian Federation as part of World-class Research Center program: Advanced Digital Technologies (075-15-2020-903)
- Fundamental Research Funds for the Central Universities (lzujbky-2019-89, lzuxxxy-2019-tm11)
This publication has 51 references indexed in Scilit:
- An Adaptive Subpixel Mapping Method Based on MAP Model and Class Determination Strategy for Hyperspectral Remote Sensing ImageryIEEE Transactions on Geoscience and Remote Sensing, 2014
- Acceleration-Level Inequality-Based MAN Scheme for Obstacle Avoidance of Redundant Robot ManipulatorsIEEE Transactions on Industrial Electronics, 2014
- A Gradient-Based Neural Network Method for Solving Strictly Convex Quadratic Programming ProblemsCognitive Computation, 2014
- Adaptive Neural Tracking Control for a Class of Nonstrict-Feedback Stochastic Nonlinear Systems With Unknown Backlash-Like HysteresisIEEE Transactions on Neural Networks and Learning Systems, 2013
- A control-theoretic study on iterative solutions to nonlinear equations for applications in embedded systemsAutomatica, 2012
- Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraintsPhysics Letters A, 2009
- Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignmentIEEE Transactions on Neural Networks, 2002
- A projection neural network and its application to constrained optimization problemsIEEE Transactions on Circuits and Systems I: Regular Papers, 2002
- Recurrent neural network for solving quadratic programming problems with equality constraintsElectronics Letters, 1992
- Neural networks for nonlinear programmingIEEE Transactions on Circuits and Systems, 1988