Practical Bounds on Image Denoising: From Estimation to Information
- 15 November 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 20 (5) , 1221-1233
Abstract
Recently, in a previous work, we proposed a way to bound how well any given image can be denoised. The bound was computed directly from the noise-free image that was assumed to be available. In this work, we extend the formulation to the more practical case where no ground truth is available. We show that the parameters of the bounds, namely the cluster covariances and level of redundancy for patches in the image, can be estimated directly from the noise corrupted image. Further, we analyze the bounds formulation to show that these two parameters are interdependent and they, along with the bounds formulation as a whole, have a nice information-theoretic interpretation as well. The results are verified through a variety of well-motivated experiments.Keywords
This publication has 35 references indexed in Scilit:
- Bias reduction via linear combination of nearest neighbour entropy estimatorsInternational Journal of Information and Coding Theory, 2009
- A class of Rényi information estimators for multidimensional densitiesThe Annals of Statistics, 2008
- What makes a good model of natural images?2007
- A new class of random vector entropy estimators and its applications in testing statistical hypothesesJournal of Nonparametric Statistics, 2005
- Expressions for Rényi and Shannon entropies for multivariate distributionsStatistics & Probability Letters, 2005
- Estimating mutual informationPhysical Review E, 2004
- Nearest Neighbor Estimates of EntropyAmerican Journal of Mathematical and Management Sciences, 2003
- On Advances in Statistical Modeling of Natural ImagesJournal of Mathematical Imaging and Vision, 2003
- Natural Image Statistics and Neural RepresentationAnnual Review of Neuroscience, 2001
- Information-theoretic asymptotics of Bayes methodsIEEE Transactions on Information Theory, 1990