An Adaptive Multiobjective Approach to Evolving ART Architectures
- 17 February 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 21 (4) , 529-550
Abstract
In this paper, we present the evolution of adaptive resonance theory (ART) neural network architectures (classifiers) using a multiobjective optimization approach. In particular, we propose the use of a multiobjective evolutionary approach to simultaneously evolve the weights and the topology of three well-known ART architectures; fuzzy ARTMAP (FAM), ellipsoidal ARTMAP (EAM), and Gaussian ARTMAP (GAM). We refer to the resulting architectures as MO-GFAM, MO-GEAM, and MO-GGAM, and collectively as MO-GART. The major advantage of MO-GART is that it produces a number of solutions for the classification problem at hand that have different levels of merit [accuracy on unseen data (generalization) and size (number of categories created)]. MO-GART is shown to be more elegant (does not require user intervention to define the network parameters), more effective (of better accuracy and smaller size), and more efficient (faster to produce the solution networks) than other ART neural network architectures that have appeared in the literature. Furthermore, MO-GART is shown to be competitive with other popular classifiers, such as classification and regression tree (CART) and support vector machines (SVMs).Keywords
This publication has 42 references indexed in Scilit:
- GFAM: Evolving Fuzzy ARTMAP neural networksNeural Networks, 2007
- Multi-class ROC analysis from a multi-objective optimisation perspectivePattern Recognition Letters, 2006
- μARTMAP: use of mutual information for category reduction in Fuzzy ARTMAPIEEE Transactions on Neural Networks, 2002
- Three-objective genetics-based machine learning for linguistic rule extractionInformation Sciences, 2001
- A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problemsStructural and Multidisciplinary Optimization, 1997
- Selecting fuzzy if-then rules for classification problems using genetic algorithmsIEEE Transactions on Fuzzy Systems, 1995
- Rule Extraction: From Neural Architecture to Symbolic RepresentationConnection Science, 1995
- An evolutionary algorithm that constructs recurrent neural networksIEEE Transactions on Neural Networks, 1994
- Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance systemNeural Networks, 1991
- A massively parallel architecture for a self-organizing neural pattern recognition machineComputer Vision, Graphics, and Image Processing, 1987