Boosted multivariate trees for longitudinal data
Authors:
Open Access
- 4 November 2016
- journal article
- research article
- Published by Springer Nature in Machine Learning
- Vol. 106 (2) , 277-305
Abstract
Machine learning methods provide a powerful approach for analyzing longitudinal data in which repeated measurements are observed for a subject over time. We boost multivariate trees to fit a novel flexible semi-nonparametric marginal model for longitudinal data. In this model, features are assumed to be nonparametric, while feature-time interactions are modeled semi-nonparametrically utilizing P-splines with estimated smoothing parameter. In order to avoid overfitting, we describe a relatively simple in sample cross-validation method which can be used to estimate the optimal boosting iteration and which has the surprising added benefit of stabilizing certain parameter estimates. Our new multivariate tree boosting method is shown to be highly flexible, robust to covariance misspecification and unbalanced designs, and resistant to overfitting in high dimensions. Feature selection can be used to identify important features and feature-time interactions. An application to longitudinal data of forced 1-second lung expiratory volume (FEV1) for lung transplant patients identifies an important feature-time interaction and illustrates the ease with which our method can find complex relationships in longitudinal data.Keywords
Funding Information
- National Institutes of Health (R01CA16373, RO1HL103552)
This publication has 22 references indexed in Scilit:
- Prediction intervals for future BMI values of individual children - a non-parametric approach by quantile boostingBMC Medical Research Methodology, 2012
- Regularization for Generalized Additive Mixed Models by Likelihood-based BoostingMethods of Information in Medicine, 2012
- A boosting approach to flexible semiparametric mixed modelsStatistics in Medicine, 2006
- Unbiased Recursive Partitioning: A Conditional Inference FrameworkJournal of Computational and Graphical Statistics, 2006
- Generalized Additive Modeling with Implicit Variable Selection by Likelihood‐Based BoostingBiometrics, 2006
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Nonparametric smoothing estimates of time-varying coefficient models with longitudinal dataBiometrika, 1998
- Flexible smoothing with B-splines and penaltiesStatistical Science, 1996
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- That BLUP is a Good Thing: The Estimation of Random EffectsStatistical Science, 1991