A Weighted Ensemble Learning Algorithm Based on Diversity Using a Novel Particle Swarm Optimization Approach
Open Access
- 9 October 2020
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 13 (10) , 255
Abstract
In ensemble learning, accuracy and diversity are the main factors affecting its performance. In previous studies, diversity was regarded only as a regularization term, which does not sufficiently indicate that diversity should implicitly be treated as an accuracy factor. In this study, a two-stage weighted ensemble learning method using the particle swarm optimization (PSO) algorithm is proposed to balance the diversity and accuracy in ensemble learning. The first stage is to enhance the diversity of the individual learner, which can be achieved by manipulating the datasets and the input features via a mixed-binary PSO algorithm to search for a set of individual learners with appropriate diversity. The purpose of the second stage is to improve the accuracy of the ensemble classifier using a weighted ensemble method that considers both diversity and accuracy. The set of weighted classifier ensembles is obtained by optimization via the PSO algorithm. The experimental results on 30 UCI datasets demonstrate that the proposed algorithm outperforms other state-of-the-art baselines.Keywords
This publication has 54 references indexed in Scilit:
- Special Issue on Ensemble Learning and ApplicationsAlgorithms, 2020
- An Ensemble Deep Learning-Based Cyber-Attack Detection in Industrial Control SystemIEEE Access, 2020
- An ensemble learning approach for brain cancer detection exploiting radiomic featuresComputer Methods and Programs in Biomedicine, 2020
- Improved change monitoring using an ensemble of time series algorithmsRemote Sensing of Environment, 2020
- A Deep CNN Ensemble Framework for Efficient DDoS Attack Detection in Software Defined NetworksIEEE Access, 2020
- Effective automatic defect classification process based on CNN with stacking ensemble model for TFT-LCD panelJournal of Intelligent Manufacturing, 2019
- Champion-challenger analysis for credit card fraud detection: Hybrid ensemble and deep learningExpert Systems with Applications, 2019
- Transferring Ensemble Representations Using Deep Convolutional Neural Networks for Small-Scale Image ClassificationIEEE Access, 2019
- An ensemble learning approach for XSS attack detection with domain knowledge and threat intelligenceComputers & Security, 2019
- A negative correlation ensemble transfer learning method for fault diagnosis based on convolutional neural networkMathematical Biosciences and Engineering, 2019