CTELC: A Constant-Time Ensemble Learning Classifier Based on KNN for Big Data
Open Access
- 22 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 89791-89802
Abstract
Big data classification is a challenging task because most known classification methods need a long time and a lot of processing resources to execute such a task and use the vast amount of available data. In this paper, we propose a novel big data classification method that leverages the power of the KNN classifier and the efficiency of the ensemble learning technique to create a new method capable of performing classification tasks on big data efficiently. The proposed method picks tiny data chunks at random from a big dataset, with each chunk including random examples of a small number of randomly selected features. A weak KNN classifier is employed on each data chunk to perform classification on new (unseen) data, and the majority voting rule is used to reach the final classification decision based on the outcomes of the weak classifiers. The proposed method has a constant classification time, according to the time complexity analysis. Furthermore, the proposed method was found to be more efficient on a single node than existing methods, some of which run on a large cluster of nodes. Because of its speed and enhanced performance, the proposed method can be considered an ideal classifier for handling complex data types such as Geospatial data, Big trajectory data, and Big Data in general.Keywords
This publication has 67 references indexed in Scilit:
- Magnetic energy-based feature extraction for low-quality fingerprint imagesSignal, Image and Video Processing, 2018
- The pattern of social media use and its association with academic performance among medical studentsMedical Teacher, 2018
- Efficient tree classifiers for large scale datasetsNeurocomputing, 2018
- RETRACTED ARTICLE: Image pattern recognition in big data: taxonomy and open challenges: surveyMultimedia Tools and Applications, 2017
- kNN-IS: An Iterative Spark-based design of the k-Nearest Neighbors classifier for big dataKnowledge-Based Systems, 2017
- Exact p-values for pairwise comparison of Friedman rank sums, with application to comparing classifiersBMC Bioinformatics, 2017
- A MapReduce-Based k-Nearest Neighbor Approach for Big Data Classification2015
- Construction of indoor floor plan and localizationWireless Networks, 2015
- Convenience or Nuisance?: The ‘WhatsApp’ DilemmaProcedia - Social and Behavioral Sciences, 2014
- Searching for exotic particles in high-energy physics with deep learningNature Communications, 2014