Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Authors:
- 11 May 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Evolutionary Computation
- Vol. 17 (3) , 368-386
Abstract
In classification, machine learning algorithms can suffer a performance bias when data sets are unbalanced. Data sets are unbalanced when at least one class is represented by only a small number of training examples (called the minority class), while the other class(es) make up the majority. In this scenario, classifiers can have good accuracy on the majority class, but very poor accuracy on the minority class(es). This paper proposes a multiobjective genetic programming (MOGP) approach to evolving accurate and diverse ensembles of genetic program classifiers with good performance on both the minority and majority of classes. The evolved ensembles comprise of nondominated solutions in the population where individual members vote on class membership. This paper evaluates the effectiveness of two popular Pareto-based fitness strategies in the MOGP algorithm (SPEA2 and NSGAII), and investigates techniques to encourage diversity between solutions in the evolved ensembles. Experimental results on six (binary) class imbalance problems show that the evolved ensembles outperform their individual members, as well as single-predictor methods such as canonical GP, naive Bayes, and support vector machines, on highly unbalanced tasks. This highlights the importance of developing an effective fitness evaluation strategy in the underlying MOGP algorithm to evolve good ensemble members.Keywords
This publication has 31 references indexed in Scilit:
- Classification as Clustering: A Pareto Cooperative-Competitive GP ApproachEvolutionary Computation, 2011
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Exploiting Diversity in Ensembles: Improving the Performance on Unbalanced Datasets2007
- Ensemble Learning Using Multi-Objective Evolutionary AlgorithmsJournal of Mathematical Modelling and Algorithms, 2006
- Training Genetic Programming on Half a Million Patterns: An Example From Anomaly DetectionIEEE Transactions on Evolutionary Computation, 2005
- Strategies for learning in class imbalance problemsPattern Recognition, 2003
- Pareto Neuro-Ensembles2003
- A fast and elitist multiobjective genetic algorithm: NSGA-IIIEEE Transactions on Evolutionary Computation, 2002
- Ensemble Methods in Machine Learning2000
- Making use of population information in evolutionary artificial neural networksIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1998