Reinforcement Learning Solution for Cyber-Physical Systems Security Against Replay Attacks
Top Cited Papers
- 19 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 18 (15566013) , 2583-2595
Abstract
The security problem of state estimation plays a critical role in monitoring and managing operation of cyber-physical systems (CPS). This paper considers the problem of network security under replay attacks and formulates a novel attack detection method. More specifically, we design a model-free reinforcement learning-based replay attack detection framework that can automatically learn and recognize the evolving attacks with more effectiveness. Attackers in some situations are more like intelligent agents with initiative, who can transform their attack strategies purposefully according to the actions of defenders. Thus, we propose a new defense strategy against the interaction between the attacker and the defender which is solved by optimization learning. The proposed analytical procedure concerning reinforcement learning technology can also be extended to the study of other control applications. Finally, the numerical examples are provided to illustrate the effectiveness of the detection method.Keywords
Funding Information
- National Natural Science Foundation of China (62122026, 61973123)
- Program of Introducing Talents of Discipline to Universities (B17017)
- Shuguang Program through the Shanghai Education Development Foundation and the Shanghai Municipal Education Commission
- Special Project of Military Civilian Integration Development in Shanghai (2019-jmrh1-kj25)
This publication has 28 references indexed in Scilit:
- Satisfaction based Q-learning for integrated lighting and blind controlEnergy and Buildings, 2016
- SINR-Based DoS Attack on Remote State Estimation: A Game-Theoretic ApproachIEEE Transactions on Control of Network Systems, 2016
- On the Performance Degradation of Cyber-Physical Systems Under Stealthy Integrity AttacksIEEE Transactions on Automatic Control, 2015
- Optimal Denial-of-Service Attack Scheduling With Energy ConstraintIEEE Transactions on Automatic Control, 2015
- Optimal DoS attack policy against remote state estimation2013
- Detecting Integrity Attacks on SCADA SystemsIEEE Transactions on Control Systems Technology, 2013
- On the Performance Analysis of Resilient Networked Control Systems Under Replay AttacksIEEE Transactions on Automatic Control, 2013
- An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential gamesAutomatica, 2011
- Distributed Kalman filtering for sensor networks2007
- Value-function reinforcement learning in Markov gamesCognitive Systems Research, 2001