Universal Zero-Delay Joint Source–Channel Coding
Authors:
- 30 November 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 52 (12) , 5240-5250
Abstract
We consider zero-delay joint source-channel coding of individual source sequences for a general known channel. Given an arbitrary finite set of schemes with finite-memory (not necessarily time-invariant) decoders, a scheme is devised that does essentially as well as the best in the set on all individual source sequences. Using this scheme, we construct a universal zero-delay joint source-channel coding scheme that is guaranteed to achieve, asymptotically, the performance of the best zero-delay encoding-decoding scheme with a finite-state encoder and a Markov decoder, on all individual sequences. For the case where the channel is a discrete memoryless channel (DMC), we construct an implementable zero-delay joint source-channel coding scheme that is based on the "follow the perturbed leader" scheme of Gyoumlrgy for lossy source coding of individual sequences. Our scheme is guaranteed to attain asymptotically the performance of the best in the set of all encoding-decoding schemes with a "symbol-by-symbol" decoder (and arbitrary encoder), on all individual sequencesKeywords
This publication has 21 references indexed in Scilit:
- On the optimality of symbol-by-symbol filtering and denoisingIEEE Transactions on Information Theory, 2005
- Universal discrete denoising: known channelIEEE Transactions on Information Theory, 2005
- Source coding exponents for zero-delay coding with finite memoryIEEE Transactions on Information Theory, 2003
- Causal source coding of stationary sources with high resolution2002
- On limited-delay lossy coding and filtering of individual sequencesIEEE Transactions on Information Theory, 2002
- A zero-delay sequential scheme for lossy coding of individual sequencesIEEE Transactions on Information Theory, 2001
- On optimal finite-state digital transmission systemsIEEE Transactions on Information Theory, 1982
- Distortion-rate theory for individual sequencesIEEE Transactions on Information Theory, 1980
- Causal sliding block encoders with feedback (Corresp.)IEEE Transactions on Information Theory, 1979
- A note on the observation of a Markov source through a noisy channel (Corresp.)IEEE Transactions on Information Theory, 1974