A globally convergent and consistent method for estimating the shape parameter of a generalized Gaussian distribution
Author:
- 23 January 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 52 (2) , 510-527
Abstract
We propose a novel methodology for estimating the shape parameter of a generalized Gaussian distribution (GGD). This new method is based on a simple estimating equation derived from a convex shape equation. The estimating equation is completely independent of gamma and polygamma functions. Thus, no lookup table, interpolation, or additional subroutine to evaluate these functions are required for real-time implementations of the proposed method, which is in contrast to all existing methods. Furthermore, we establish that the shape equation has a unique global root on the positive real line and the Newton-Raphson root-finding algorithm converges to the unique global root from any starting point in a semi-infinite interval Thetamin. More importantly, we show that the sample-based shape estimating equation has a unique global root with probability tending to one and the root is consistent for the true shape parameter. Finally, we prove via fixed point arguments that, with probability tending to one, the Newton-Raphson algorithm converges to the unique global root of the sample shape estimating equation from any starting point in Thetamin. Some numerical experiments are also provided to demonstrate the global convergence and the excellent finite sample performance of the proposed methodKeywords
This publication has 15 references indexed in Scilit:
- Statistical texture characterization from discrete wavelet representationsIEEE Transactions on Image Processing, 1999
- On the generalized Cramer-Rao bound for the estimation of the locationIEEE Transactions on Signal Processing, 1997
- Image subband coding using arithmetic coded trellis coded quantizationIEEE Transactions on Circuits and Systems for Video Technology, 1995
- Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of videoIEEE Transactions on Circuits and Systems for Video Technology, 1995
- On the modeling of DCT and subband image data for compressionIEEE Transactions on Image Processing, 1995
- Subband image coding using entropy-coded quantization over noisy channelsIEEE Journal on Selected Areas in Communications, 1992
- Parametric generalized Gaussian density estimationThe Journal of the Acoustical Society of America, 1989
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989
- Optimum quantizer performance for a class of non-Gaussian memoryless sourcesIEEE Transactions on Information Theory, 1984
- Cox's Regression Model for Counting Processes: A Large Sample StudyThe Annals of Statistics, 1982