Online Learning of Minmax Solutions for Distributed Estimation and Tracking Control of Sensor Networks in Graphical Games
- 13 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control of Network Systems
- Vol. 9 (4) , 1923-1936
Abstract
In this paper, a new target tracking algorithm that is based on a distributed estimation-based control protocol is developed for multiple moving sensors subject to adversarial inputs. An augmented system composed of both the estimation error dynamics and the tracking error dynamics is introduced for the distributed estimation and target tracking control problem. We integrate estimation and control to simultaneously minimize infinite-horizon estimation and tracking errors in sensor networks with disturbances. A Minmax strategy as an alternative goal to Nash equilibrium is proposed to compute sensor’s optimal motion controls in the presence of worst-case neighbor controls and disturbances. In contrast to Nash, Minmax yields a distributed algebraic Riccati equation (ARE) that is easily solved locally by each sensor. A method based on reinforcement learning (RL) is given to compute sensor motion inputs so that all sensors estimate and track the target states. Value function approximation (VFA) using neural networks (NNs) is used to solve the distributed Bellman equations online based on real-time observed data. Proofs are given to guarantee the performance of the combined distributed estimation and tracking algorithms. Finally, the simulation examples show the effectiveness of the proposed algorithm.Keywords
Funding Information
- ONR (N00014-18-1-2221)
- National Science Foundation (ECCS-1839804, CNS-1730675)
This publication has 35 references indexed in Scilit:
- Fuzzy Observed-Based Adaptive Consensus Tracking Control for Second-Order Multiagent Systems With Heterogeneous Nonlinear DynamicsIEEE Transactions on Fuzzy Systems, 2015
- Optimal Distributed Finite-Time Consensus On Unknown Undirected GraphsIEEE Transactions on Control of Network Systems, 2015
- Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear SystemsIEEE Transactions on Cybernetics, 2014
- Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown DynamicsIEEE Transactions on Automation Science and Engineering, 2014
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimalityAutomatica, 2012
- How Hard Is It to Approximate the Best Nash Equilibrium?SIAM Journal on Computing, 2011
- Leader–follower cooperative attitude control of multiple rigid bodiesSystems & Control Letters, 2009
- Distributed Tracking for Mobile Sensor Networks with Information-Driven MobilityAmerican Control Conference (ACC), 2007
- Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networksNeural Networks, 1990