Anomaly Detection on Time Series Sensor Data Using Deep LSTM-Autoencoder
Authors:
- 20 September 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Anomaly detection is crucial in various applications (e.g., cybersecurity, manufacturing, finance, IoT), and an automatic and reliable anomaly detection tool is necessary for accurate prediction. The proposed method in this paper focuses on using deep LSTM Autoencoder on time-series data from loT water level sensors deployed on a water catchment. The method uses unsupervised anomaly detection with deviation methods, which involves lower-dimensional embeddings and reconstruction error. The LSTM Autoencoder model includes feature selection by keeping vital features, and learns the time series' encoded representation. The LSTM model is trained for prediction with three hidden layers based on the encoder's latent layer output. Afterwards, given the output from the prediction model if the reconstruction loss of a data point is greater than reconstruction error threshold the value will be labeled anomaly. We also propose and compare an unconventional method of calculating reconstruction error of each sequence with an aim of reducing false positives and false negatives then compare it with frequently used method. The results show that the LSTM Autoencoder performs well on noisy and real-world datasets for detecting anomalies and also the proposed unconventional method of calculating reconstruction loss increases the models accuracy in identifying anomalies.Keywords
This publication has 12 references indexed in Scilit:
- Detecting anomalies in time series data from a manufacturing system using recurrent neural networksJournal of Manufacturing Systems, 2022
- Deep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and GuidelinesIEEE Access, 2021
- Semi-supervised Time Series Anomaly Detection Model Based on LSTM Autoencoder2021
- Unsupervised Anomaly Detection in Time Series Using LSTM-Based Autoencoders2019
- Real-Time Anomaly Detection for Flight Testing Using AutoEncoder and LSTM2019
- PC2A: Predicting Collective Contextual Anomalies via LSTM With Deep Generative ModelIEEE Internet of Things Journal, 2019
- Multivariate LSTM-FCNs for time series classificationNeural Networks, 2019
- f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networksMedical Image Analysis, 2019
- Spatio-temporal Anomaly Detection in Intelligent Transportation SystemsProcedia Computer Science, 2019
- Outlier detection for wireless sensor networks using density‐based clustering approachIET Wireless Sensor Systems, 2017