Variable Selection and Model Choice in Geoadditive Regression Models
- 28 May 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 65 (2) , 626-634
Abstract
SummaryModel choice and variable selection are issues of major concern in practical regression analyses, arising in many biometric applications such as habitat suitability analyses, where the aim is to identify the influence of potentially many environmental conditions on certain species. We describe regression models for breeding bird communities that facilitate both model choice and variable selection, by a boosting algorithm that works within a class of geoadditive regression models comprising spatial effects, nonparametric effects of continuous covariates, interaction surfaces, and varying coefficients. The major modeling components are penalized splines and their bivariate tensor product extensions. All smooth model terms are represented as the sum of a parametric component and a smooth component with one degree of freedom to obtain a fair comparison between the model terms. A generic representation of the geoadditive model allows us to devise a general boosting algorithm that automatically performs model choice and variable selection.Keywords
This publication has 16 references indexed in Scilit:
- Boosting Algorithms: Regularization, Prediction and Model FittingStatistical Science, 2007
- Generalized Additive Modeling with Implicit Variable Selection by Likelihood‐Based BoostingBiometrics, 2006
- Boosting for high-dimensional linear modelsThe Annals of Statistics, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Multivariate calibration with temperature interaction using two-dimensional penalized signal regressionChemometrics and Intelligent Laboratory Systems, 2003
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- The Variable Selection ProblemJournal of the American Statistical Association, 2000
- The Variable Selection ProblemJournal of the American Statistical Association, 2000
- Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors)The Annals of Statistics, 2000
- Flexible smoothing with B-splines and penaltiesStatistical Science, 1996