Noise prediction for channels with side information at the transmitter
Authors:
- R. ZamirRZR. Zamir
- 1 July 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 46 (4) , 1610-1617
Abstract
The computation of channel capacity with side information at the transmitter side (but not at the receiver side) requires, in general, extension of the input alphabet to a space of “strategies”, and is often hard. We consider the special case of a discrete memoryless module-additive noise channel Y=X+Zs, where the encoder observes causally the random state S∈S that governs the distribution of the noise Zs. We show that the capacity of this channel is given by C=log|χ|-mint:S→χH(Z S-t(S)). This capacity is realized by a state-independent code, followed by a shift by the “noise prediction” tmin(S) that minimizes the entropy of Zs-t(S). If the set of conditional noise distributions {p(z|s),s∈S} is such that the optimum predictor tmin(·) is independent of the state weights, then C is also the capacity for a noncausal encoder, that observes the entire state sequence in advance. Furthermore, for this case we also derive a simple formula for the capacity when the state process has memoryKeywords
This publication has 12 references indexed in Scilit:
- Capacity of Markov channels with receiver CSI and delayed feedbackIEEE Transactions on Information Theory, 1999
- On the capacity of some channels with channel state informationIEEE Transactions on Information Theory, 1999
- Capacity and coding for memories with real-time noisy defect informatiom at encoder and decoderIEE Proceedings I Communications, Speech and Vision, 1992
- Channels with block interferenceIEEE Transactions on Information Theory, 1984
- On the capacity of computer memory with defectsIEEE Transactions on Information Theory, 1983
- Writing on dirty paper (Corresp.)IEEE Transactions on Information Theory, 1983
- Determination of capacity achieving input probabilities for a class of finite state channels with side informationInformation and Control, 1966
- Coding Theorems of Information Theory1964
- Channels with Side Information at the TransmitterIBM Journal of Research and Development, 1958
- Predictive coding--IIIEEE Transactions on Information Theory, 1955