A Discretization Algorithm of Continuous Attributes Based on Supervised Clustering
Authors:
- Haiyang HuaHHHaiyang Hua
- Huaici ZhaoHZHuaici Zhao
Open Access
- 1 November 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Many machine learning algorithms can be applied only to data described by categorical attributes. So discretization of continuous attributes is one of the important steps in preprocessing of extracting knowledge. Traditional discretization algorithms based on clustering need a pre-determined clustering number k, also typically are applied in an unsupervised learning framework. This paper describes such an algorithm, called SX-means (Supervised X-means), which is a new algorithm of supervised discretization of continuous attributes on clustering .The algorithm modifies clusters with knowledge of the class distribution dynamically. And this procedure can not stop until the proper k is found. For the number of clusters k is not pre-determined by the user and class distribution is applied, the random of result is decreased greatly. Experimental evaluation of several discretization algorithms on six artificial data sets show that the proposed algorithm is more efficient and can generate a better discretization schema. Comparing the output of C4.5, resulting tree is smaller, less classification rules, and high accuracy of classification.Keywords
This publication has 8 references indexed in Scilit:
- Adapting k-means for supervised clusteringApplied Intelligence, 2006
- Supervised clustering - algorithms and benefits2005
- Building multi-way decision trees with numerical attributesInformation Sciences, 2004
- CAIM discretization algorithmIEEE Transactions on Knowledge and Data Engineering, 2004
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz CriterionJournal of the American Statistical Association, 1995
- Class-dependent discretization for inductive learning from continuous and mixed-mode dataIEEE Transactions on Pattern Analysis and Machine Intelligence, 1995
- Synthesizing Statistical Knowledge from Incomplete Mixed-Mode DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 1987
- Induction of decision treesMachine Learning, 1986