Second-Order Asymptotics in Fixed-Length Source Coding and Intrinsic Randomness
Author:
Top Cited Papers
- 16 September 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 54 (10) , 4619-4637
Abstract
There is a difference between the optimal rates of fixed-length source coding and intrinsic randomness when we care about the second-order asymptotics. We prove this difference for general information sources and then investigate independent and identically distributed (i.i.d.) random variables and Markovian variables as examples. The difference is demonstrated through an investigation of the second-order asymptotic behavior of the rates. A universal fixed-length source code attaining the second-order optimal rate is also proposed. The difference between the rates of fixed-length source coding and intrinsic randomness proves that the outputs of fixed-length source codes are not uniformly distributed.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- An Information-Spectrum Approach to Classical and Quantum Hypothesis Testing for Simple HypothesesIEEE Transactions on Information Theory, 2007
- General formulas for fixed-length quantum entanglement concentrationIEEE Transactions on Information Theory, 2006
- On the Asymptotic Redundancy of Lossless Block Coding With Two Codeword LengthsIEEE Transactions on Information Theory, 2005
- Analytic variations on redundancy rates of renewal processesIEEE Transactions on Information Theory, 2002
- Source code with cost as a nonuniform random number generatorIEEE Transactions on Information Theory, 2000
- On a (145, 32) binary cyclic codeIEEE Transactions on Information Theory, 1999
- Simulation of random processes and rate-distortion theoryIEEE Transactions on Information Theory, 1996
- Generating random bits from an arbitrary source: fundamental limitsIEEE Transactions on Information Theory, 1995
- Jeffreys' prior is asymptotically least favorable under entropy riskJournal of Statistical Planning and Inference, 1994
- A continuity property of the entropy density for spin lattice systemsCommunications in Mathematical Physics, 1973