Fence methods for mixed model selection
Authors:
- Jiming JiangJJJiming Jiang
- J. Sunil RaoJRJ. Sunil Rao
- Zhonghua GuZGZhonghua Gu
- Thuan NguyenTNThuan Nguyen
Open Access
- 1 August 2008
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 36 (4) , 1669-1692
Abstract
Many model search strategies involve trading off model fit with model complexity in a penalized goodness of fit measure. Asymptotic properties for these types of procedures in settings like linear regression and ARMA time series have been studied, but these do not naturally extend to nonstandard situations such as mixed effects models, where simple definition of the sample size is not meaningful. This paper introduces a new class of strategies, known as fence methods, for mixed model selection, which includes linear and generalized linear mixed models. The idea involves a procedure to isolate a subgroup of what are known as correct models (of which the optimal model is a member). This is accomplished by constructing a statistical fence, or barrier, to carefully eliminate incorrect models. Once the fence is constructed, the optimal model is selected from among those within the fence according to a criterion which can be made flexible. In addition, we propose two variations of the fence. The first is a stepwise procedure to handle situations of many predictors; the second is an adaptive approach for choosing a tuning constant. We give sufficient conditions for consistency of fence and its variations, a desirable property for a good model selection procedure. The methods are illustrated through simulation studies and real data analysis.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Fence methods for mixed model selectionThe Annals of Statistics, 2008
- Counting degrees of freedom in hierarchical and other richly-parameterised modelsBiometrika, 2001
- Scales of Evidence for Model Selection: Fisher versus Jeffreys2001
- An Error-Components Model for Prediction of County Crop Areas Using Survey and Satellite DataJournal of the American Statistical Association, 1988
- Asymptotic Properties of Criteria for Selection of Variables in Multiple RegressionThe Annals of Statistics, 1984
- Approximate efficiency of a selection procedure for the number of regression variablesBiometrika, 1984
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- Asymptotic Properties of Maximum Likelihood Estimates in the Mixed Model of the Analysis of VarianceThe Annals of Statistics, 1977
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Maximum-likelihood estimation for the mixed analysis of variance modelBiometrika, 1967