Path selection with Nash Q‐learning for remote state estimation over multihop relay network
Authors:
- 4 March 2020
- journal article
- research article
- Published by Wiley in International Journal of Robust and Nonlinear Control
- Vol. 30 (11) , 4331-4344
Abstract
Summary: In this article, the security issue of remote state estimation is investigated for multihop relay networks interrupted by an attacker launching denial‐of‐service attacks. Since the presence of the relay enriches the communication topology, there might exist several paths connecting the sensor and the estimator, consisting of the corresponding channels. Thus, it is reasonable for the sensor to select the path with a lower dropout rate to enhance the system performance measured by the estimation error, due to the dropout rate changing with the channel. However, as an adversary, the objective of the jammer is to deteriorate the corresponding performance through launching attack on the communication path selectively. For addressing the problem on the behalf of both of the sensor and the jammer, we first formulate this problem as a two‐player zero‐sum stochastic game model, and then present a Nash Q‐learning algorithm to explore the equilibrium point for both players, under the assumption that both of them are rational players. Furthermore, the existence of equilibrium point for this problem is proved analytically. Moreover, a more general case of the channel attack, under which the jammer can attack any channels among this network, is considered. Finally, numerical results are presented to verify the effectiveness of the algorithm proposed and the theorem results.Keywords
Funding Information
- China Postdoctoral Science Foundation (2017M612944, 2018T110962)
- Fundamental Research Funds for the Central Universities of China (ZYGX2018J087)
- National Natural Science Foundation of China (U1830207, 61772003, 61903066, 61873106)
This publication has 22 references indexed in Scilit:
- On Finite-State Stochastic Modeling and Secure Estimation of Cyber-Physical SystemsIEEE Transactions on Automatic Control, 2016
- Kalman Filtering With Relays Over Wireless Fading ChannelsIEEE Transactions on Automatic Control, 2015
- Health-CPS: Healthcare Cyber-Physical System Assisted by Cloud and Big DataIEEE Systems Journal, 2015
- Energy-Efficient Data Forwarding for State Estimation in Multi-Hop Wireless Sensor NetworksIEEE Transactions on Automatic Control, 2015
- Detection of Faults and Attacks Including False Data Injection Attack in Smart Grid Using Kalman FilterIEEE Transactions on Control of Network Systems, 2014
- Enhancing link quality in a multi-hop relay in LTE-A employing directional antenna2013
- Outage probability analysis for a cognitive amplify‐and‐forward relay network with single and multi‐relay selectionIET Communications, 2013
- Attack Detection and Identification in Cyber-Physical SystemsIEEE Transactions on Automatic Control, 2013
- Essentials of Game Theory: A Concise Multidisciplinary IntroductionSynthesis Lectures on Artificial Intelligence and Machine Learning, 2008
- Generalized LQR Control and Kalman Filtering With Relations to Computations of Inner–Outer and Spectral FactorizationsIEEE Transactions on Automatic Control, 2006