On the robustness of the adaptive lasso to model misspecification
Open Access
- 11 July 2012
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 99 (3) , 717-731
Abstract
Penalization methods have been shown to yield both consistent variable selection and oracle parameter estimation under correct model specification. In this article, we study such methods under model misspecification, where the assumed form of the regression function is incorrect, including generalized linear models for uncensored outcomes and the proportional hazards model for censored responses. Estimation with the adaptive least absolute shrinkage and selection operator, lasso, penalty is proven to achieve sparse estimation of regression coefficients under misspecification. The resulting estimators are selection consistent, asymptotically normal and oracle, where the selection is based on the limiting values of the parameter estimators obtained using the misspecified model without penalization. We further derive conditions under which the penalized estimators from the misspecified model may yield selection consistency under the true model. The robustness is explored numerically via simulation and an application to the Wisconsin Epidemiological Study of Diabetic Retinopathy.Keywords
This publication has 24 references indexed in Scilit:
- Profile-kernel likelihood inference with diverging number of parametersThe Annals of Statistics, 2008
- Robust inference for univariate proportional hazards frailty regression modelsThe Annals of Statistics, 2004
- Nonconcave penalized likelihood with a diverging number of parametersThe Annals of Statistics, 2004
- Variable Selection for Cox's proportional Hazards Model and Frailty ModelThe Annals of Statistics, 2002
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- The Wisconsin epidemiologic study of diabetic retinopathy: XVIIOphthalmology, 1998
- The Wisconsin Epidemiologic Study of Diabetic RetinopathyArchives of Ophthalmology (1950), 1989
- The Wisconsin Epidemiologic Study of Diabetic RetinopathyArchives of Ophthalmology (1950), 1984
- Cox's Regression Model for Counting Processes: A Large Sample StudyThe Annals of Statistics, 1982
- Maximum likelihood identification of Gaussian autoregressive moving average modelsBiometrika, 1973