Confidence sets for split points in decision trees
Authors:
- Moulinath BanerjeeMBMoulinath Banerjee
- Ian W. McKeagueIMIan W. McKeague
Open Access
- 1 April 2007
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 35 (2) , 543-574
Abstract
We investigate the problem of finding confidence sets for split points in decision trees (CART). Our main results establish the asymptotic distribution of the least squares estimators and some associated residual sum of squares statistics in a binary decision tree approximation to a smooth regression curve. Cube-root asymptotics with nonnormal limit distributions are involved. We study various confidence sets for the split point, one calibrated using the subsampling bootstrap, and others calibrated using plug-in estimates of some nuisance parameters. The performance of the confidence sets is assessed in a simulation study. A motivation for developing such confidence sets comes from the problem of phosphorus pollution in the Everglades. Ecologists have suggested that split points provide a phosphorus threshold at which biological imbalance occurs, and the lower endpoint of the confidence set may be interpreted as a level that is protective of the ecosystem. This is illustrated using data from a Duke University Wetlands Center phosphorus dosing study in the Everglades.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Confidence sets for nonparametric wavelet regressionThe Annals of Statistics, 2005
- A continuous mapping theorem for the argmax‐functional in the non‐unique caseStatistica Neerlandica, 2004
- Two statistical methods for the detection of environmental thresholdsEcological Modelling, 2003
- Analyzing baggingThe Annals of Statistics, 2002
- Nonparametric estimation of a discontinuity in regressionStatistica Neerlandica, 2002
- Likelihood Ratio Tests for Monotone FunctionsThe Annals of Statistics, 2001
- Empirical-Bias Bandwidths for Local Polynomial Nonparametric Regression and Density EstimationJournal of the American Statistical Association, 1997
- Large Sample Confidence Regions Based on Subsamples under Minimal AssumptionsThe Annals of Statistics, 1994
- Cube Root AsymptoticsThe Annals of Statistics, 1990
- Estimation of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1981