Clustering based approach for incomplete data streams processing
Authors:
- 22 January 2020
- journal article
- research article
- Published by SAGE Publications in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
- Vol. 38 (3) , 3213-3227
Abstract
Recent applications such as sensor networks generate continuous and dynamic data streams. Data streams are often gathered from multiple data sources with some incompleteness. Clustering such data is constrained by incompleteness of data, data distribution, and continuous nature of data streams. Ignoring missing values in incomplete data clustering, especially in high missing rates decreases the clustering performance. Traditional clustering is applied on the whole data without dealing with data distribution. This paper presents an efficient framework called Fuzzy c-means clustering for Incomplete Data streams (FID) that works adaptively with incomplete data streams even with high missing rates. The proposed FID estimates missing values based on the corresponding nearest-neighbors’ intervals. To overcome the previously mentioned data streams clustering problems, the continuous clustering mechanism is adopted and extended to accurately handle the incomplete data streams. Experimental results using two different data sets prove the efficiency of the proposed FID comparing to the alternative approaches.Keywords
This publication has 37 references indexed in Scilit:
- Making kernel-based vector quantization robust and effective for incomplete educational data clusteringVietnam Journal of Computer Science, 2016
- Processing Incomplete k Nearest Neighbor SearchIEEE Transactions on Fuzzy Systems, 2016
- A Global Clustering Approach Using Hybrid Optimization for Incomplete Data Based on Interval Reconstruction of Missing ValueInternational Journal of Intelligent Systems, 2015
- Incomplete high-dimensional data imputation algorithm using feature selection and clustering analysis on cloudThe Journal of Supercomputing, 2015
- Greedy algorithm for subspace clustering from corrupted and incomplete data2015
- Hierarchical Fuzzy Clustering in Conjunction with Particle Swarm Optimization to Efficiently Design RBF Neural NetworksJournal of Intelligent & Robotic Systems, 2014
- Concept lattice compression in incomplete contexts based on K-medoids clusteringInternational Journal of Machine Learning and Cybernetics, 2014
- Recognizing Daily and Sports Activities in Two Open Source Machine Learning Environments Using Body-Worn Sensor UnitsThe Computer Journal, 2013
- Comparative study on classifying human activities with miniature inertial and magnetic sensorsPattern Recognition, 2010
- Human Activity Recognition Using Inertial/Magnetic Sensor Units2010