Cost-Sensitive Classification: Empirical Evaluation of a Hybrid Genetic Decision Tree Induction Algorithm
Author:
Preprint
Abstract
This paper introduces ICET, a new algorithm for cost-sensitive classification. ICET uses a genetic algorithm to evolve a population of biases for a decision tree induction algorithm. The fitness function of the genetic algorithm is the average cost of classification when using the decision tree, including both the costs of tests (features, measurements) and the costs of classification errors. ICET is compared here with three other algorithms for cost-sensitive classification - EG2, CS-ID3, and IDX - and also with C4.5, which classifies without regard to cost. The five algorithms are evaluated empirically on five real-world medical datasets. Three sets of experiments are performed. The first set examines the baseline performance of the five algorithms on the five datasets and establishes that ICET performs significantly better than its competitors. The second set tests the robustness of ICET under a variety of conditions and shows that ICET maintains its advantage. The third set looks at ICET's search in bias space and discovers a way to improve the search.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Learning and evolution: A quantitative genetics approachJournal of Theoretical Biology, 1995
- Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin EffectEvolutionary Computation, 1993
- Automated network troubleshooting knowledge acquisitionApplied Intelligence, 1991
- Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.The Journal of Philosophy, 1991
- Explicitly biased generalizationComputational Intelligence, 1989
- CANALIZATION OF DEVELOPMENT AND THE INHERITANCE OF ACQUIRED CHARACTERSNature, 1942
- On Modification and VariationScience, 1896
- A New Factor in EvolutionThe American Naturalist, 1896