Parameter Bounds on Estimation Accuracy Under Model Misspecification
Authors:
- 6 March 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 63 (9) , 2263-2278
Abstract
When the assumed data distribution differs from the true distribution, the model is said to be misspecified or mismatched. Model misspecification at some level is an inevitability of engineering practice. While Huber's celebrated work assesses maximum-likelihood (ML) performance under misspecification, no simple theory for bounding parameter estimation exists. The class of parameter bounds emerging from the covariance inequality, or equivalently the minimum norm theorem is revisited. The expectation operator is well-known to form an inner product space. Flexibility in the choice of expectation integrand and measure for integration exists, however, to establish a class of parameter bounds under a general form of model misspecification, i.e., distribution mismatch. The Cramér-Rao bound (CRB) primarily, and secondarily the Barankin/Hammersley-Chapman-Robbins, Bhattacharyya, and Bobrovsky-Mayer-Wolf-Zakai bounds under misspecification are considered. Huber's sandwich covariance is readily established as a special case of the misspecified CRB subject to ML constraints, and generalizations of the Slepian and Bangs formulae under misspecification are obtained.Keywords
Funding Information
- Intelligence Advanced Research Projects Activity IARPA
This publication has 22 references indexed in Scilit:
- A Fresh Look at the Bayesian Bounds of the Weiss-Weinstein FamilyIEEE Transactions on Signal Processing, 2008
- Mean-squared error and threshold SNR prediction of maximum-likelihood signal parameter estimation with estimated colored noise covariancesIEEE Transactions on Information Theory, 2006
- A Bound on Mean-Square Estimation Error With Background Parameter MismatchIEEE Transactions on Information Theory, 2004
- Computing the Barankin bound, by solving an unconstrained quadratic optimization problem2002
- On lower bounds for deterministic parameter estimation2002
- A Cramer-Rao lower bound for complex parametersIEEE Transactions on Signal Processing, 1994
- A general class of lower bounds in parameter estimationIEEE Transactions on Information Theory, 1988
- Lower bounds on the mean square estimation errorProceedings of the IEEE, 1985
- Locally Best Unbiased EstimatesThe Annals of Mathematical Statistics, 1949
- Note on the Consistency of the Maximum Likelihood EstimateThe Annals of Mathematical Statistics, 1949