Comparative analysis of imputation methods in machine learning models
- 9 October 2025
- journal article
- Published by State Scientific Institution - Ukrainian Institute of Scientific and Technical Expertise and Info in Science Technologies Innovation
- No. 3(35),p. 61
Abstract
Missing data is a prevalent issue in machine learning and data analysis that impacts the credibility and performance of predictive models. This article provides a comprehensive study of missing data, its types, consequences, and popular imputation methods. Using real datasets, we compare the performance of Mean/Median Imputation, K-Nearest Neighbors (KNN) Imputation, Multiple Imputation, Regression Imputation, and Hot Deck Imputation. Furthermore, we study how these imputation techniques affect machine learning models such as Random Forest, Gradient Boosting Machines (GBM), and Support Vector Machines (SVM). Our study emphasizes the need for careful experimentation and model-specific investigation when handling missing data, where an important part is played by the selection of suitable imputation techniques based on dataset attributes and machine learning models. Lastly, our findings underscore the importance of tailored imputation strategies in enhancing model fit and ensuring stable analytical findings.Keywords
This publication has 15 references indexed in Scilit:
- Missing data: the impact of what is not thereEuropean Journal of Endocrinology, 2020
- A Comparison of Multiple Imputation Methods for Data with Missing ValuesIndian Journal of Science and Technology, 2017
- Random ForestJournal of Insurance Medicine, 2017
- A hot deck imputation procedure for multiply imputing nonignorable missing data: The proxy pattern-mixture hot deckComputational Statistics & Data Analysis, 2015
- Iterative stepwise regression imputation using standard and robust methodsComputational Statistics & Data Analysis, 2011
- Missing Data Analysis: Making It Work in the Real WorldAnnual Review of Psychology, 2009
- Support Vector Machines (SVM) as a Technique for Solvency AnalysisSSRN Electronic Journal, 2008
- Imputation of missing longitudinal data: a comparison of methodsJournal of Clinical Epidemiology, 2003
- Handling Missing Data in Trees: Surrogate Splits or Statistical Imputation?1999
- Inference and missing dataBiometrika, 1976