On Shannon’s Formula and Hartley’s Rule: Beyond the Mathematical Coincidence
Open Access
- 10 September 2014
- Vol. 16 (9) , 4892-4910
Abstract
In the information theory community, the following “historical” statements are generally well accepted: (1) Hartley did put forth his rule twenty years before Shannon; (2) Shannon’s formula as a fundamental tradeoff between transmission rate, bandwidth, and signal-to-noise ratio came out unexpected in 1948; (3) Hartley’s rule is inexact while Shannon’s formula is characteristic of the additive white Gaussian noise channel; (4) Hartley’s rule is an imprecise relation that is not an appropriate formula for the capacity of a communication channel. We show that all these four statements are somewhat wrong. In fact, a careful calculation shows that “Hartley’s rule” in fact coincides with Shannon’s formula. We explain this mathematical coincidence by deriving the necessary and sufficient conditions on an additive noise channel such that its capacity is given by Shannon’s formula and construct a sequence of such channels that makes the link between the uniform (Hartley) and Gaussian (Shannon) channels.Keywords
This publication has 17 references indexed in Scilit:
- Multiplex signal transmission and the development of sampling techniques: the work of Herbert Raabe in contrast to that of Claude ShannonApplicable Analysis, 2011
- Information Theoretic Proofs of Entropy Power InequalitiesIEEE Transactions on Information Theory, 2010
- Claude E. Shannon: a retrospective on his life, work, and impactIEEE Transactions on Information Theory, 2001
- Fifty years of Shannon theoryIEEE Transactions on Information Theory, 1998
- A conversation with Claude ShannonIEEE Communications Magazine, 1984
- Information theory in the fiftiesIEEE Transactions on Information Theory, 1973
- The early days of information theoryIEEE Transactions on Information Theory, 1973
- What is information theory? (Edtl.)IRE Transactions on Information Theory, 1956
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948
- Transmission of Information1Bell System Technical Journal, 1928