An Information-Theoretic Analysis of Discrete-Time Control and Filtering Limitations by the I-MMSE Relationships
- 19 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (9) , 5926-5940
Abstract
Fundamental limitations or performance tradeoffs/limits are important properties and constraints of both control and filtering systems. Among various tradeoff metrics, total information rate that characterizes the sensitivity tradeoffs and time-averaged performance of control and filtering systems was conventionally studied by using the differential entropy rate and Kolmogorov–Bode formula. In this article, by extending the famous mutual information-minimum mean-square error (I-MMSE) relationships to the discrete-time additive white Gaussian channels with and without feedback, a new paradigm is introduced to estimate and analyze total information rate as a control and filtering tradeoff metric. Under this framework, we explore the tradeoff properties of total information rate for a variety of the discrete-time control and filtering systems, e.g., linear time-invariant, linear time-varying, and nonlinear, and propose an alternative approach to investigate total information rate via optimal estimation.Keywords
All Related Versions
Funding Information
- Air Force Office of Scientific Research (FA9550-21-1-0411)
- NASA (80NSSC20M0229, 80NSSC22M0070)
- NSF (CMMI-2135925)
This publication has 60 references indexed in Scilit:
- Towards Integrating Control and Information Theories2017
- General equivalence between two kinds of noise-correlation filtersAutomatica, 2014
- On disturbance propagation in leader–follower systems with limited leader informationAutomatica, 2014
- Exponential dichotomy on the real line: SVD and QR methodsJournal of Differential Equations, 2010
- Optimal State Estimation2006
- Elements of Information Theory2001
- Statistics of Random Processes2001
- Dichotomy, discrete Bohl exponents, and spectrum of block weighted shiftsIntegral Equations and Operator Theory, 1991
- State-space formulae for all stabilizing controllers that satisfy an H∞-norm bound and relations to relations to risk sensitivitySystems & Control Letters, 1988
- Information and filteringInformation Sciences, 1979