Ensemble-based discriminant learning with boosting for face recognition
Authors:
- S.Z. LiSLS.Z. Li
- 13 February 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 17 (1) , 166-178
Abstract
In this paper, we propose a novel ensemble-based approach to boost performance of traditional Linear Discriminant Analysis (LDA)-based methods used in face recognition. The ensemble-based approach is based on the recently emerged technique known as "boosting". However, it is generally believed that boosting-like learning rules are not suited to a strong and stable learner such as LDA. To break the limitation, a novel weakness analysis theory is developed here. The theory attempts to boost a strong learner by increasing the diversity between the classifiers created by the learner, at the expense of decreasing their margins, so as to achieve a tradeoff suggested by recent boosting studies for a low generalization error. In addition, a novel distribution accounting for the pairwise class discriminant information is introduced for effective interaction between the booster and the LDA-based learner. The integration of all these methodologies proposed here leads to the novel ensemble-based discriminant learning approach, capable of taking advantage of both the boosting and LDA techniques. Promising experimental results obtained on various difficult face recognition scenarios demonstrate the effectiveness of the proposed approach. We believe that this work is especially beneficial in extending the boosting framework to accommodate general (strong/weak) learners.Keywords
This publication has 49 references indexed in Scilit:
- Population theory for boosting ensemblesThe Annals of Statistics, 2004
- Mixtures of local linear subspaces for face recognition2002
- Bagging, Boosting and the Random Subspace Method for Linear ClassifiersPattern Analysis and Applications, 2002
- Boosting the margin: a new explanation for the effectiveness of voting methodsThe Annals of Statistics, 1998
- Arcing classifier (with discussion and a rejoinder by the author)The Annals of Statistics, 1998
- Example-based learning for view-based human face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Bagging predictorsMachine Learning, 1996
- The Nature of Statistical Learning Theory1995
- View-based and modular eigenspaces for face recognition1994