A New Sequential Covering Strategy for Inducing Classification Rules With Ant Colony Algorithms
- 10 February 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Evolutionary Computation
- Vol. 17 (1) , 64-76
Abstract
Ant colony optimization (ACO) algorithms have been successfully applied to discover a list of classification rules. In general, these algorithms follow a sequential covering strategy, where a single rule is discovered at each iteration of the algorithm in order to build a list of rules. The sequential covering strategy has the drawback of not coping with the problem of rule interaction, i.e., the outcome of a rule affects the rules that can be discovered subsequently since the search space is modified due to the removal of examples covered by previous rules. This paper proposes a new sequential covering strategy for ACO classification algorithms to mitigate the problem of rule interaction, where the order of the rules is implicitly encoded as pheromone values and the search is guided by the quality of a candidate list of rules. Our experiments using 18 publicly available data sets show that the predictive accuracy obtained by a new ACO classification algorithm implementing the proposed sequential covering strategy is statistically significantly higher than the predictive accuracy of state-of-the-art rule induction classification algorithms.Keywords
This publication has 22 references indexed in Scilit:
- Multiple pheromone types and other extensions to the Ant-Miner classification rule discovery algorithmSwarm Intelligence, 2011
- An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive modelsDecision Support Systems, 2011
- Editorial survey: swarm intelligence for data miningMachine Learning, 2010
- A Hybrid PSO/ACO Algorithm for Discovering Classification Rules in Data MiningJournal of Artificial Evolution and Applications, 2008
- Benchmarking state-of-the-art classification algorithms for credit scoringJournal of the Operational Research Society, 2003
- Data mining with an ant colony optimization algorithmIEEE Transactions on Evolutionary Computation, 2002
- Introduction2002
- Improvements on the Ant-System: Introducing the MAX-MIN Ant System1998
- On the handling of continuous-valued attributes in decision tree generationMachine Learning, 1992
- The CN2 induction algorithmMachine Learning, 1989