Median-KNN Regressor-SMOTE-Tomek Links for Handling Missing and Imbalanced Data in Air Quality Prediction
Open Access
Abstract
The Air Quality Index (AQI) dataset contains information on measurements of pollutants and ambient air quality conditions at certain location that can be used to predict air quality. Unfortunately, this dataset often has many missing observations and imbalanced classes. Both of these problems can affect the performance of the prediction model. In particular, predictions for the minority class are very important because inaccurate predictions can be fatal or cause big losses. Moreover, the missing data may lead to biased results. This paper proposes the single imputation of the median and the multiple imputations of the -Nearest Neighbor (KNN) regressor to handle missing values of less than or equal to 10% and more than 10%, respectively. At the same time, the SMOTE-Tomek Links address the imbalanced class. These proposed approaches to handle both issues are then used to assess the air quality prediction of the India AQI dataset using Naive Bayes (NB), KNN, and C4.5. The five treatments show that the proposed method of the Median-KNN regressor-SMOTE-Tomek Links is able to improve the performance of the India air quality prediction model. In other words, the proposed method succeeds in overcoming the problems of missing values and class imbalance.
Keywords
This publication has 32 references indexed in Scilit:
- A novel k NN algorithm with data-driven k parameter computationPattern Recognition Letters, 2018
- Air quality forecasting based on cloud model granulationEURASIP Journal on Wireless Communications and Networking, 2018
- Comparing the Behavior of Oversampling and Undersampling Approach of Class Imbalance Learning by Combining Class Imbalance Problem with Noise2017
- Cross-validation based K nearest neighbor imputation for software quality datasets: An empirical studyJournal of Systems and Software, 2017
- Adjusted weight voting algorithm for random forests in handling missing valuesPattern Recognition, 2017
- Performance Analysis of Various Missing Value Imputation Methods on Heart Failure Dataset2017
- Missing Data2016
- Effective prediction of three common diseases by combining SMOTE with Tomek links technique for imbalanced medical data2016
- Missing Values and Optimal Selection of an Imputation Method and Classification Algorithm to Improve the Accuracy of Ubiquitous Computing ApplicationsMathematical Problems in Engineering, 2015
- Flexible Imputation of Missing Data2012