Geometric Decision Tree
Authors:
- 1 September 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Vol. 42 (1) , 181-192
Abstract
In this paper, we present a new algorithm for learning oblique decision trees. Most of the current decision tree algorithms rely on impurity measures to assess the goodness of hyperplanes at each node while learning a decision tree in top-down fashion. These impurity measures do not properly capture the geometric structures in the data. Motivated by this, our algorithm uses a strategy for assessing the hyperplanes in such a way that the geometric structure in the data is taken into account. At each node of the decision tree, we find the clustering hyperplanes for both the classes and use their angle bisectors as the split rule at that node. We show through empirical studies that this idea leads to small decision trees and better performance. We also present some analysis to show that the angle bisectors of clustering hyperplanes that we use as the split rules at each node are solutions of an interesting optimization problem and hence argue that this is a principled method of learning a decision tree.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Pareto-optimality of oblique decision trees from evolutionary algorithmsJournal of Global Optimization, 2010
- Top-Down Induction of Decision Trees Classifiers—A SurveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2005
- Inducing oblique decision trees with evolutionary algorithmsIEEE Transactions on Evolutionary Computation, 2003
- Two Timescale Analysis of the Alopex Algorithm for OptimizationNeural Computation, 2002
- A new LDA-based face recognition system which can solve the small sample size problemPattern Recognition, 2000
- Globally optimal fuzzy decision trees for classification and regressionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- New algorithms for learning and pruning oblique decision treesIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 1999
- Induction of decision treesMachine Learning, 1986
- Piecewise linear classification using seniority logic committee methods, with application to remote sensingPattern Recognition, 1984
- Multisurface method of pattern separationIEEE Transactions on Information Theory, 1968