Finite-Time Nonanticipative Rate Distortion Function for Time-Varying Scalar-Valued Gauss-Markov Sources
- 28 November 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 2 (1) , 175-180
Abstract
We derive the finite-time horizon nonanticipative rate distortion function (NRDF) of time-varying scalar Gauss–Markov sources under an average mean squared-error (MSE) distortion fidelity. Further, we show that a conditionally Gaussian reproduction process realizes the optimal reproduction distribution, and this is determined from the solution of a dynamic reverse-waterfilling optimization problem. We provide an iterative algorithm that approximates the solution of the dynamic reverse-waterfilling problem. From the above results, we also obtain, as a special case, the NRDF under a per-letter or pointwise MSE distortion fidelity, and we draw connections to the classical RDF of Gaussian processes. Our results are corroborated with illustrative examples.Keywords
This publication has 11 references indexed in Scilit:
- Filtering with fidelity for time-varying Gauss-Markov processes2016
- Directed Information on Abstract Spaces: Properties and Variational EqualitiesIEEE Transactions on Information Theory, 2016
- Semidefinite Programming Approach to Gaussian Sequential Rate-Distortion Trade-OffsIEEE Transactions on Automatic Control, 2016
- Improved Upper Bounds to the Causal Quadratic Rate-Distortion Function for Gaussian Stationary SourcesIEEE Transactions on Information Theory, 2012
- Rate-Distortion Functions for Nonstationary Gaussian Autoregressive Processes2008
- Stochastic Linear Control Over a Communication ChannelIEEE Transactions on Automatic Control, 2004
- Convex Optimization2004
- A Weak Convergence Approach to the Theory of Large Deviations1997
- Causal source codesIEEE Transactions on Information Theory, 1982
- On the Shannon theory of information transmission in the case of continuous signalsIRE Transactions on Information Theory, 1956