Discriminant Component Pruning: Regularization and Interpretation of Multilayered Backpropagation Networks
Authors:
- 1 April 1999
- journal article
- review article
- Published by MIT Press in Neural Computation
- Vol. 11 (3) , 783-802
Abstract
Neural networks are often employed as tools in classification tasks. The use of large networks increases the likelihood of the task's being learned, although it may also lead to increased complexity. Pruning is an effective way of reducing the complexity of large networks. We present discriminant components pruning (DCP), a method of pruning matrices of summed contributions between layers of a neural network. Attempting to interpret the underlying functions learned by the network can be aided by pruning the network. Generalization performance should be maintained at its optimal level following pruning. We demonstrate DCP's effectiveness at maintaining generalization performance, applicability to a wider range of problems, and the usefulness of such pruning for network interpretation. Possible enhancements are discussed for the identification of the optimal reduced rank and inclusion of nonlinear neural activation functions in the pruning algorithm.Keywords
This publication has 5 references indexed in Scilit:
- Rule generation from neural networksIEEE Transactions on Systems, Man, and Cybernetics, 1994
- Pruning algorithms-a surveyIEEE Transactions on Neural Networks, 1993
- Principal Component Analysis with External Information on both Subjects and VariablesPsychometrika, 1991
- Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal DistributionsThe Annals of Mathematical Statistics, 1951
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936