Bounds for joint source-channel coding at high SNR
Authors:
- 1 July 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 771-775
Abstract
Shannon's capacity and rate-distortion function, combined with the separation principle, provide tight bounds for the minimum possible distortion in joint source-channel coding. These bounds, however, are usually achievable only in the limit of large block length. In their 1973 paper, Ziv and Zakai provide a family of alternative capacity and rate-distortion functions, based on functionals satisfying the data-processing inequality, which potentially give tighter bounds for systems with a small block length, e.g., for scalar modulation. We examine a recently proposed approximation for the Ziv-Zakai bounds based on the Rényi-divergence functional. For the specific case of a uniform source, we derive explicit bounds on the Ziv-Zakai-Rényi rate- distortion function, which prove this approximation in the limit of small distortion. Our results can be extended, using the same technique, to more general sources.Keywords
This publication has 6 references indexed in Scilit:
- Distortion lower bounds for finite dimensional joint source-channel coding2008
- CramÉr–Rao and Moment-Entropy Inequalities for Renyi Entropy and Generalized Fisher InformationIEEE Transactions on Information Theory, 2005
- Convex Optimization2004
- On the asymptotic tightness of the Shannon lower boundIEEE Transactions on Information Theory, 1994
- On functionals satisfying a data-processing theoremIEEE Transactions on Information Theory, 1973
- Theoretical limitations on the transmission of data from analog sourcesIEEE Transactions on Information Theory, 1965