Resilient Autonomous Control of Distributed Multiagent Systems in Contested Environments
- 17 August 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 49 (11) , 3957-3967
Abstract
An autonomous and resilient controller is proposed for leader-follower multiagent systems under uncertainties and cyber-physical attacks. The leader is assumed nonautonomous with a nonzero control input, which allows changing the team behavior or mission in response to the environmental changes. A resilient learning-based control protocol is presented to find optimal solutions to the synchronization problem in the presence of attacks and system dynamic uncertainties. An observer-based distributed H∞ controller is first designed to prevent propagating the effects of attacks on sensors and actuators throughout the network, as well as to attenuate the effect of these attacks on the compromised agent itself. Nonhomogeneous game algebraic Riccati equations are derived to solve the H∞ optimal synchronization problem and off-policy reinforcement learning (RL) is utilized to learn their solution without requiring any knowledge of the agent's dynamics. A trust-confidence-based distributed control protocol is then proposed to mitigate attacks that hijack the entire node and attacks on communication links. A confidence value is defined for each agent based solely on its local evidence. The proposed resilient RL algorithm employs the confidence value of each agent to indicate the trustworthiness of its own information and broadcast it to its neighbors to put weights on the data they receive from it during and after learning. If the confidence value of an agent is low, it employs a trust mechanism to identify compromised agents and remove the data it receives from them from the learning process. The simulation results are provided to show the effectiveness of the proposed approach.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Resilient Distributed Control in the Presence of Misbehaving Agents in Networked Control SystemsIEEE Transactions on Cybernetics, 2014
- Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control ApproachIEEE Transactions on Neural Networks and Learning Systems, 2013
- Attack Detection and Identification in Cyber-Physical SystemsIEEE Transactions on Automatic Control, 2013
- Adaptive Learning in Tracking Control Based on the Dual Critic Network DesignIEEE Transactions on Neural Networks and Learning Systems, 2013
- Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamicsAutomatica, 2012
- Online solution of nonlinear two‐player zero‐sum games using synchronous policy iterationInternational Journal of Robust and Nonlinear Control, 2011
- Consensus Computation in Unreliable Networks: A System Theoretic ApproachIEEE Transactions on Automatic Control, 2011
- Tracking control for multi-agent consensus with an active leader and variable topologyAutomatica, 2006
- Information Flow and Cooperative Control of Vehicle FormationsIEEE Transactions on Automatic Control, 2004
- Coordination of groups of mobile autonomous agents using nearest neighbor rulesIEEE Transactions on Automatic Control, 2003