Anomaly detection in groundwater monitoring data using LSTM-Autoencoder neural networks
- 4 July 2024
- journal article
- research article
- Published by Springer Nature in Environmental Monitoring and Assessment
- Vol. 196 (8) , 1-16
Abstract
Groundwater monitoring data can be prone to errors and biases due to various factors like borehole and equipment malfunctions, or human mistakes. These inaccuracies can jeopardize the groundwater system, leading to reduced efficiency and potentially causing partial or complete failures in the monitoring system. Traditional anomaly detection methods, which rely on statistical and time-variant techniques, struggle to handle the complex and dynamic nature of anomalies. With advancements in artificial intelligence and the growing need for effective anomaly detection and prevention across different sectors, artificial neural network methods are emerging as capable of identifying more intricate anomalies by considering both temporal and contextual aspects. Nonetheless, there is still a shortage of comprehensive studies on groundwater anomaly detection. The intricate patterns of sequential data from groundwater present numerous challenges, necessitating sophisticated modeling techniques that combine mathematics, statistics, and machine learning for viable solutions. This paper introduces a model designed for high accuracy and efficient computation in detecting anomalies in groundwater monitoring data through a probabilistic approach. We employed the Monte Carlo method and SEAWAT numerical simulation to ascertain the uncertainty in groundwater salinity. Subsequently, a Long Short-Term Memory (LSTM)-Autoencoder model was trained and evaluated, forming the basis of an anomaly detection framework. Each piece of training data was assessed by the LSTM-Autoencoder using the Negative Log Likelihood (NLL) score and a predefined threshold to determine the data’s abnormality percentage. The accuracy evaluation of the proposed LSTM-Autoencoder algorithm revealed that this approach achieved commendable performance, with an accuracy of 98.47% in anomaly detection. Graphical AbstractKeywords
This publication has 59 references indexed in Scilit:
- Autoencoders for unsupervised anomaly detection in high energy physicsJournal of High Energy Physics, 2021
- An integrated statistical-graphical approach for the appraisal of the natural background levels of some major ions and potentially toxic elements in the groundwater of Urmia aquifer, IranEnvironmental Earth Sciences, 2021
- A Review of Time-Series Anomaly Detection Techniques: A Step to Future Perspectives2021
- RADSSo: An Automated Tool for the multi-CASH Machine Learning Problem2020
- Beginning Anomaly Detection Using Python-Based Deep Learning2019
- Anomaly Detection and Reliability Analysis of Groundwater by Crude Monte Carlo and Importance Sampling ApproachesWater Resources Management, 2018
- An Introduction to Outlier Ensembles2017
- A new parameter estimation procedure for pumping test analysis using a radial basis function collocation methodEnvironmental Earth Sciences, 2016
- Modeling Groundwater Flow and Seawater Intrusion in the Coastal Aquifer of Wadi Ham, UAEWater Resources Management, 2011
- Surface Soil Geochemistry for Environmental Assessment in Kavala Area, Northern GreeceWater, Air, & Soil Pollution, 2010