Weighted ensemble based on 0‐1 matrix decomposition
Authors:
Open Access
- 1 January 2013
- journal article
- information and-communications
- Published by Institution of Engineering and Technology (IET) in Electronics Letters
- Vol. 49 (2) , 116-118
Abstract
A simple effective ensemble method is proposed in which individual classifiers are combined with the weight coefficients obtained by decomposition for the 0‐1 matrix. The 0‐1 matrix is introduced to denote individual classifiers of the ensemble and is constructed based on the prediction labels of individuals and the true labels. The weight coefficients of individuals are obtained by singular value decomposition for the 0‐1 matrix based on linear mapping. In particular, the square of elements of the right singular vector corresponding to the maximum singular value are as the weight coefficients of individuals, and it is proved theoretically that it minimises the upper bound of ensemble error. Experimental results illustrate that the proposed method improves the performance of classification compared against standard ensemble strategies.Keywords
This publication has 5 references indexed in Scilit:
- Hierarchical Ensemble of Global and Local Classifiers for Face RecognitionIEEE Transactions on Image Processing, 2009
- Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Creating diversity in ensembles using artificial dataInformation Fusion, 2005
- Bagging predictorsMachine Learning, 1996
- A Singularly Valuable Decomposition: The SVD of a MatrixThe College Mathematics Journal, 1996