Universal discrete denoising: known channel
Authors:
- E. OrdentlichEOE. Ordentlich
- G. SeroussiGSG. Seroussi
- S. VerduSVS. Verdu
- M.J. WeinbergerMWM.J. Weinberger
- 10 January 2005
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 51 (1) , 5-28
Abstract
A discrete denoising algorithm estimates the input sequence to a discrete memoryless channel (DMC) based on the observation of the entire output sequence. For the case in which the DMC is known and the quality of the reconstruction is evaluated with a given single-letter fidelity criterion, we propose a discrete denoising algorithm that does not assume knowledge of statistical properties of the input sequence. Yet, the algorithm is universal in the sense of asymptotically performing as well as the optimum denoiser that knows the input sequence distribution, which is only assumed to be stationary. Moreover, the algorithm is universal also in a semi-stochastic setting, in which the input is an individual sequence, and the randomness is due solely to the channel noise. The proposed denoising algorithm is practical, requiring a linear number of register-level operations and sublinear working storage size relative to the input data length.Keywords
This publication has 65 references indexed in Scilit:
- Adaptive wavelet thresholding for image denoising and compressionIEEE Transactions on Image Processing, 2000
- Filtering random noise from deterministic signals via data compressionIEEE Transactions on Signal Processing, 1995
- Compression of individual sequences via variable-rate codingIEEE Transactions on Information Theory, 1978
- The Sequential Compound Decision Problem with $m \times n$ Finite Loss MatrixThe Annals of Mathematical Statistics, 1966
- Convergence of the Losses of Certain Decision Rules for the Sequential Compound Decision ProblemThe Annals of Mathematical Statistics, 1964
- An Empirical Bayes Approach to the Testing of Certain Parametric HypothesesThe Annals of Mathematical Statistics, 1963
- Asymptotic Solutions of the Sequential Compound Decision ProblemThe Annals of Mathematical Statistics, 1963
- Probability Inequalities for Sums of Bounded Random VariablesJournal of the American Statistical Association, 1963
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960
- Asymptotic Solutions of the Compound Decision Problem for Two Completely Specified DistributionsThe Annals of Mathematical Statistics, 1955