PPtree: Projection pursuit classification tree
Authors:
- Yoon Dong LeeYLYoon Dong Lee
- Dianne CookDCDianne Cook
- Ji-Won ParkJPJi-Won Park
- Eun-Kyung LeeELEun-Kyung Lee
Open Access
- 1 January 2013
- journal article
- research article
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 7 (none) , 1369-1386
Abstract
In this paper, we propose a new classification tree, the projection pursuit classification tree (PPtree). It combines tree structured methods with projection pursuit dimension reduction. This tree is originated from the projection pursuit method for classification. In each node, one of the projection pursuit indices using class information - LDA, $L_{r}$ or PDA indices - is maximized to find the projection with the most separated group view. On this optimized data projection, the tree splitting criteria are applied to separate the groups. These steps are iterated until the last two classes are separated. The main advantages of this tree is that it effectively uses correlation between variables to find separations, and it has visual representation of the differences between groups in a 1-dimensional space that can be used to interpret results. Also in each node of the tree, the projection coefficients represent the variable importance for the group separation. This information is very helpful to select variables in classification problems.
Keywords
This publication has 14 references indexed in Scilit:
- Improving the precision of classification treesThe Annals of Applied Statistics, 2009
- Projection Pursuit for Exploratory Supervised ClassificationJournal of Computational and Graphical Statistics, 2005
- Classification Trees With Bivariate Linear Discriminant Node ModelsJournal of Computational and Graphical Statistics, 2003
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression DataJournal of the American Statistical Association, 2002
- Classification Trees With Unbiased Multiway SplitsJournal of the American Statistical Association, 2001
- Tree-Structured Classification via Generalized Discriminant AnalysisJournal of the American Statistical Association, 1988
- An Exploratory Technique for Investigating Large Quantities of Categorical DataJournal of the Royal Statistical Society Series C: Applied Statistics, 1980
- Binary Segmentation in Survey Analysis with Particular Reference to AIDJournal of the Royal Statistical Society: Series D (The Statistician), 1977
- A multivariate study of variation in two species of rock crab of the genus LeptograpsusAustralian Journal of Zoology, 1974
- A Modal Search Technique for Predictive Nominal Scale Multivariate AnalysisJournal of the American Statistical Association, 1972