Abstract
In this paper, the security issue of remote state estimation in cyber-physical systems (CPSs) for multi-hop networks is investigated. A smart sensor transmits its local estimate to a remote estimator through some relay nodes to save limited energy while facing the threat of a malicious Denial-of-Service (DoS) attacker. Due to the energy constraints, the defender allocates transmitting energy on each channel to minimize the estimation error, while the attacker selects the attacking energy implemented on each channel to maximize the degradation of the estimation performance. Supposing that the attacker cannot obtain the acknowledgment, and considering the interaction between the defender and the attacker, a dynamic game with asymmetric information is formulated. To overcome the computational difficulty, this game is transformed into a belief-based stochastic game (BBSG) with symmetric information such that the Nash equilibrium of the original game can be determined by solving the BBSG. Furthermore, a multi-agent Q-learning algorithm is proposed to obtain the optimal strategy. A numerical example is finally provided to demonstrate the effectiveness of the results.
Funding Information
  • National Natural Science Foundation of China (62533004)
  • National Natural Science Foundation of China (U21A20477)
  • National Natural Science Foundation of China (62463005)
  • National Key Research and Development Program of China (2022YFB4701302)
  • Natural Science Foundation of Hainan Province (625MS047)