Replacing Outliers and Missing Values from Activated Sludge Data Using Kohonen Self-Organizing Map
- 1 September 2007
- journal article
- Published by American Society of Civil Engineers (ASCE) in Journal of Environmental Engineering
- Vol. 133 (9) , 909-916
Abstract
Modeling the activated sludge wastewater treatment plant plays an important role in improving its performance. However, there are many limitations of the available data for model identification, calibration, and verification, such as the presence of missing values and outliers. Because available data are generally short, these gaps and outliers in data cannot be discarded but must be replaced by more reasonable estimates. The aim of this study is to use the Kohonen self-organizing map (KSOM), unsupervised neural networks, to predict the missing values and replace outliers in time series data for an activated sludge wastewater treatment plant in Edinburgh, U.K. The method is simple, computationally efficient and highly accurate. The results demonstrated that the KSOM is an excellent tool for replacing outliers and missing values from a high-dimensional data set. A comparison of the KSOM with multiple regression analysis and back-propagation artificial neural networks showed that the KSOM is superior in per...Keywords
This publication has 10 references indexed in Scilit:
- Determination of volatile characteristics of Greek and Turkish pine honey samples and their classification by using Kohonen self organising maps☆Food Chemistry, 2007
- Optimal combination of document binarization techniques using a self-organizing map neural networkEngineering Applications of Artificial Intelligence, 2006
- Artificial neural network based generalized storage–yield–reliability models using the Levenberg–Marquardt algorithmJournal of Hydrology, 2006
- Using self-organizing maps to visualize high-dimensional dataComputers & Geosciences, 2005
- Self-organizing map and clustering for wastewater treatment monitoringEngineering Applications of Artificial Intelligence, 2004
- Handbook of Water and Wastewater Treatment Plant Operations2003
- Multivariate and multiscale monitoring of wastewater treatment operationWater Research, 2001
- Process Monitoring and Modeling Using the Self-Organizing MapIntegrated Computer-Aided Engineering, 1999
- Managing complexity in large data bases using self-organizing mapsAccounting, Management and Information Technologies, 1998
- Engineering applications of the self-organizing mapProceedings of the IEEE, 1996