Preprocessing kNN algorithm classification using K-means and distance matrix with students’ academic performance dataset
Open Access
- 21 October 2020
- journal article
- research article
- Published by Institute of Research and Community Services Diponegoro University (LPPM UNDIP) in Jurnal Teknologi dan Sistem Komputer
- Vol. 8 (4) , 311-316
Abstract
The existence of outliers in the dataset can cause low accuracy in a classification process. Outliers in the dataset can be removed from a preprocessing stage of classification algorithms. Clustering can be used as an outlier detection method. This study applies K-means and a distance matrix to detect outliers and remove them from datasets with class labels. This research used a dataset of students’ academic performance totaling 6847 instances, having 18 attributes and 3 class labels. Preprocessing applies the K-means method to get centroid in each class. The distance matrix is used to evaluate the distance of instance to the centroid. Outliers, which are a different class, will be removed from the dataset. This preprocessing improves the classification accuracy of the kNN algorithm. Data without preprocessing has 72.28 % accuracy, preprocessed data using K-means with Euclidean has 98.42 % accuracy (an increase of 26.14 %), while the K-means with Manhattan has 97.76 % accuracy (an increase of 25.48 %).Keywords
Funding Information
- UIN Sunan Kalijaga, Yogyakarta, Indonesia
This publication has 14 references indexed in Scilit:
- Pola Perwalian Sebagai Pembinaan Akademik, Kerohanian dan Karakter MahasiswaJurnal Ilmiah Religiosity Entity Humanity (JIREH), 2020
- Outlier Detection using Clustering Techniques – K-means and K-median2020
- Exemplifying the Effects of Distance Metrics on Clustering Techniques: F-measure, Accuracy and Efficiency2020
- Performance of distance-based k-nearest neighbor classification method using local mean vector and harmonic distanceIOP Conference Series: Materials Science and Engineering, 2020
- A Clustering Approach for Outliers Detection in a Big Point-of-Sales Database2019
- Outlier Detection Using Subset Formation of Clustering Based Method2018
- Performance Analysis of Uncertain K-means Clustering Algorithm Using Different Distance Metrics2018
- kNN Classification with an Outlier Informative Distance Measure2017
- Filtered Clustering Based on Local Outlier Factor in Data MiningInternational Journal of Database Theory and Application, 2016
- Automated web usage data mining and recommendation system using K-Nearest Neighbor (KNN) classification methodApplied Computing and Informatics, 2016