Abstract
How to design a Markov Decision Process (MDP) based radar controller that makes small sacrifices in performance to mask its sensing plan from an adversary? The radar controller purposefully minimizes the Fisher information of its emissions so that an adversary cannot identify the controller's model parameters accurately. Unlike classical open loop statistical inference, where the Fisher information serves as a lower bound for the achievable covariance, this paper employs the Fisher information as a design constraint for a closed loop radar controller to mask its sensing plan. We analytically derive a closed-form expression for the determinant of the Fisher Information Matrix (FIM) pertaining to the parameters of the MDP-based controller. Subsequently, we formulate an MDP which is regularized by the determinant of the adversary's FIM. This results in the perturbations to total cost of operation, stateaction costs, and the transition matrix. Additionally, we propose a Maximum Entropy-based convex lower bound for the FIMconstrained MDP, whose solution can serve as an initialization point for the proposed nonlinear optimization problem. This convex lower bound aligns with existing work that employs the same Maximum Entropy criteria to mask the sensing plan. Numerical results show that the introduction of minor perturbations to the MDP's stateaction costs, transition kernel and the total operation cost can reduce the Fisher Information of the emissions. Consequently, this reduction amplifies the variability in policy and transition kernel estimation errors, thwarting the adversary's accuracy in estimating the controller's sensing plan. We demonstrate this by comparing the error in the estimate of the transition kernel under different criteria: the FIM criteria, the Maximum Entropy criteria, a sensing plan where actions are chosen uniformly, and the unmasked sensing plan.
Funding Information
  • Army Research Office (W911NF-24-1-0083)
  • Air Force Office of Scientific Research (FA9550-22-1-0016)
  • National Science Foundation (CCF-2312198)
  • Muralidhar Rangaswamy and Bosung Kang
  • Air Force Office of Scientific Research (23RYCOR002)
  • Sandeep Gogineni was supported by AFOSR (23RYCOR003)

This publication has 37 references indexed in Scilit: