An Improved Differential Evolution Algorithm Using Mahalanobis Distance and Cholesky Decomposition for Wrapper-Based Feature Selection
Open Access
- 20 September 2026
- journal article
- research article
- Published by MDPI AG in Machine Learning and Knowledge Extraction
- Vol. 8 (9) , 291
Abstract
In machine learning, feature selection is a fundamental component that plays a crucial role in improving prediction accuracy and reducing the computational time of classification models. Feature selection involves eliminating irrelevant or redundant features that can negatively affect model learning. This article proposes a wrapper-based method that uses a binary evolutionary algorithm for feature selection. The Differential Evolution algorithm performs feature selection and is combined with Mahalanobis distance and Cholesky decomposition (MaCRO-DE). Using Cholesky decomposition to calculate Mahalanobis distance helps to determine the proximity of feature subsets, which is useful for deciding which features to select or discard. Subsequently, two classifiers (K-nearest neighbors and the support vector machine) are used as evaluators, along with a V-shaped transfer function, to identify the most suitable option for the proposed method. To evaluate the effectiveness of the proposed methodology, the CEC-2017 benchmark and twelve widely used datasets from the UCI repository are employed. Experimental tests are conducted using thirteen prominent metaheuristic algorithms. The results indicate that the proposal effectively achieves its objectives, outperforming the benchmark across the performance indicators used for comparison, including Accuracy, F1-Score, Recall, Precision, Fitness value, and number of selected features.Keywords
This publication has 33 references indexed in Scilit:
- Improved differential evolution based feature selection through chaos, quantum, and lasso logistic regressionQuantum Machine Intelligence, 2026
- Diversified clustering and archive pattern-based differential evolution for feature selection problemsCluster Computing, 2025
- A filter-wrapper model for high-dimensional feature selection based on evolutionary computationApplied Intelligence, 2025
- Dung beetle optimizer: a new meta-heuristic algorithm for global optimizationThe Journal of Supercomputing, 2022
- Dwarf Mongoose Optimization AlgorithmComputer Methods in Applied Mechanics and Engineering, 2022
- Review of swarm intelligence-based feature selection methodsEngineering Applications of Artificial Intelligence, 2021
- Battle royale optimization algorithmNeural Computing and Applications, 2020
- Harris hawks optimization: Algorithm and applicationsFuture Generation Computer Systems, 2019
- The Whale Optimization AlgorithmAdvances in Engineering Software, 2016
- Grey Wolf OptimizerAdvances in Engineering Software, 2014