Enhancing Impairment Detection in Full-Band Capture (FBC) Downstream Spectrum Data Using Unsupervised Learning Methods
Authors:
- 12 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Ensuring the reliability of telecommunication networks is paramount in today's interconnected world. To address this critical challenge, this study introduces a comprehensive preprocessing framework tailored for the full-band capture (FBC) downstream spectrum data for impairment detection. The proposed approach initiates with the identification of optimal clustering algorithms and cluster configurations, followed by within-cluster outlier detection which is a crucial preprocessing step. Subsequently, the study delves into amplitude groupings, aimed at elevating impairments detection accuracy. Experimental results demonstrate the effectiveness of this approach, showcasing improved data quality and highlighting the adaptability required in preprocessing pipelines, given the variability in algorithm and cluster count selection across diverse datasets. This research represents a significant step forward in advancing network maintenance, enhancing impairment detection tasks by providing robust preprocessing techniques for diverse FBC downstream spectrum datasets.Keywords
This publication has 16 references indexed in Scilit:
- On the nature and types of anomalies: a review of deviations in dataInternational Journal of Data Science and Analytics, 2021
- Machine learning and deep learningElectronic Markets, 2021
- Cluster Quality Analysis Using Silhouette Score2020
- Proactive Network Maintenance using Fast, Accurate Anomaly Localization and Classification on 1-D Data Series2020
- Unsupervised K-Means Clustering AlgorithmIEEE Access, 2020
- Machine learning on big data: Opportunities and challengesNeurocomputing, 2017
- Isolation Forest2008
- A tutorial on spectral clusteringStatistics and Computing, 2007
- Clustering association rules2002
- A fuzzy clustering model of data and fuzzy c-means2002