Structural Properties of the Wyner–Ziv Rate Distortion Function: Applications for Multivariate Gaussian Sources
Open Access
Abstract
The main focus of this paper is the derivation of the structural properties of the test channels of Wyner’s operational information rate distortion function (RDF), , for arbitrary abstract sources and, subsequently, the derivation of additional properties for a tuple of multivariate correlated, jointly independent, and identically distributed Gaussian random variables, , , , with average mean-square error at the decoder and the side information, , available only at the decoder. For the tuple of multivariate correlated Gaussian sources, we construct optimal test channel realizations which achieve the informational RDF, , where is the set of auxiliary RVs Z such that , , and . We show the following fundamental structural properties: (1) Optimal test channel realizations that achieve the RDF and satisfy conditional independence, (2) Similarly, for the conditional RDF, , when the side information is available to both the encoder and the decoder, we show the equality . (3) We derive the water-filling solution for .
Keywords
Funding Information
- European Regional Development Fund (EXCELLENCE/1216/0296)
This publication has 19 references indexed in Scilit:
- Structural Properties of Test Channels of the RDF for Gaussian Multivariate Distributed Sources2021
- Control and System Theory of Discrete-Time Stochastic Systems2021
- Remote Vector Gaussian Source Coding With Decoder Side Information Under Mutual Information and Distortion ConstraintsIEEE Transactions on Information Theory, 2009
- Rate-Distortion Theory for Gaussian Multiterminal Source Coding Systems With Several Side Informations at the DecoderIEEE Transactions on Information Theory, 2005
- Side Information Aware Coding Strategies for Sensor NetworksIEEE Journal on Selected Areas in Communications, 2004
- Gaussian multiterminal source codingIEEE Transactions on Information Theory, 1997
- The quadratic Gaussian CEO problemIEEE Transactions on Information Theory, 1997
- The rate-distortion function for source coding with side information at the decoder\3-II: General sourcesInformation and Control, 1978
- The rate-distortion function for source coding with side information at the decoderIEEE Transactions on Information Theory, 1976
- A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functionsIEEE Transactions on Information Theory, 1973