Testing the order of a model
Author:
- Antoine ChambazACAntoine Chambaz
Open Access
- 1 June 2006
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 34 (3) , 1166-1203
Abstract
This paper deals with order identification for nested models in the i.i.d. framework. We study the asymptotic efficiency of two generalized likelihood ratio tests of the order. They are based on two estimators which are proved to be strongly consistent. A version of Stein’s lemma yields an optimal underestimation error exponent. The lemma also implies that the overestimation error exponent is necessarily trivial. Our tests admit nontrivial underestimation error exponents. The optimal underestimation error exponent is achieved in some situations. The overestimation error can decay exponentially with respect to a positive power of the number of observations. These results are proved under mild assumptions by relating the underestimation (resp. overestimation) error to large (resp. moderate) deviations of the log-likelihood process. In particular, it is not necessary that the classical Cramér condition be satisfied; namely, the log-densities are not required to admit every exponential moment. Three benchmark examples with specific difficulties (location mixture of normal distributions, abrupt changes and various regressions) are detailed so as to illustrate the generality of our results.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Optimal error exponents in hidden markov models order estimationIEEE Transactions on Information Theory, 2003
- Likelihood ratio inequalities with applications to various mixturesAnnales de l'Institut Henri Poincaré, Probabilités et Statistiques, 2002
- Consistent estimation of mixture complexityThe Annals of Statistics, 2001
- Some applications of concentration inequalities to statisticsAnnales de la Faculté des sciences de Toulouse : Mathématiques, 2000
- Cramer's condition and Sanov's theoremStatistics & Probability Letters, 1998
- The optimal error exponent for Markov order estimationIEEE Transactions on Information Theory, 1996
- Large Deviations, Moderate Deviations and LIL for Empirical ProcessesThe Annals of Probability, 1994
- New Ways to Prove Central Limit TheoremsEconometric Theory, 1985
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974