Imbalanced Aircraft Data Anomaly Detection
- 10 September 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Aerospace and Electronic Systems
- Vol. 61 (2) , 1422-1432
Abstract
Anomaly detection in temporal data from sensors under aviation scenarios is a practical but challenging task: 1) long temporal data is difficult to extract contextual information with temporal correlation; 2) the anomalous data are rare in time series, causing normal/abnormal imbalance in anomaly detection, making the detector classification degenerate or even fail. To remedy the aforementioned problems, we propose a Graphical Temporal Data Analysis (GTDA) framework. It consists three modules, named Series-to-Image (S2I), Cluster-based Resampling Approach using Euclidean Distance (CRD) and Variance-Based Loss (VBL). Specifically, for better extracts global information in temporal data from sensors, S2I converts the data to curve images to demonstrate abnormalities in data changes. CRD and VBL balance the classification to mitigate the unequal distribution of classes. CRD extracts minority samples with similar features to majority samples by clustering and over-samples them. And VBL fine-tunes the decision boundary by balancing the fitting degree of the network to each class. Ablation experiments on the Flights dataset indicate the effectiveness of CRD and VBL on precision and recall, respectively. Extensive experiments demonstrate the synergistic advantages of CRD and VBL on F1-score on Flights and three other temporal datasets.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62306241, 61871470)
This publication has 54 references indexed in Scilit:
- Learning from Temporal Aviation Data to Detect Anomaly Events2023
- GTR-GA: Harnessing the power of graph-based neural networks and genetic algorithms for text augmentationExpert Systems with Applications, 2023
- Clustering-based anomaly detection in multivariate time series dataApplied Soft Computing, 2021
- Sentiment analysis on product reviews based on weighted word embeddings and deep neural networksConcurrency and Computation: Practice and Experience, 2020
- GAN-Based Anomaly Detection In Imbalance Problems2020
- Topic-Enriched Word Embeddings for Sarcasm Identification2019
- Ensemble of keyword extraction methods and classifiers in text classificationExpert Systems with Applications, 2016
- Cluster-based under-sampling approaches for imbalanced data distributionsExpert Systems with Applications, 2009
- Under-Sampling Approaches for Improving Prediction of the Minority Class in an Imbalanced Dataset2006
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005