An improved sliding window prediction‐based outlier detection and correction for volatile time‐series
- 21 September 2020
- journal article
- research article
- Published by Wiley in International Journal of Numerical Modelling: Electronic Networks, Devices and Fields
- Vol. 34 (1)
Abstract
Steady‐state forecasting is indispensable for power system planning and operation. A forecasting model for inputs considering their historical record is a preliminary step for such type of studies. Since the historical data quality is decisive in edifice an accurate forecasting model, data preprocessing is essential. Primarily, the quality of raw data is affected by the presence of outliers, and preprocessing refers to outlier detection and correction. In this paper, an effort is made to improve the existing sliding window prediction‐based preprocessing method. The recommended reforms are the calculation of appropriate window width and a new outlier correction approach. The proposed method denoted as improved sliding window prediction‐based preprocessing is applied to the historical data of PV generation, load power, and the ambient temperature of different time‐steps collected from various places in the United States and India. Firstly, the method's efficacy through detailed result analysis demonstrating the proposed preprocessing as a better way than its precursor and k‐nearest neighbor approach is presented. Later, the improved out‐of‐sample forecasting accuracy canonizes the proposed method’s concert compared to both the above techniques and the case without preprocessing.Keywords
This publication has 22 references indexed in Scilit:
- Correction of Outliers in Temperature Time Series Based on Sliding Window Prediction in Meteorological Sensor NetworkInformation, 2017
- Real-Time Detection of Power System Disturbances Based on $k$ -Nearest Neighbor AnalysisIEEE Access, 2017
- Identification and characterization of irregular consumptions of load dataJournal of Modern Power Systems and Clean Energy, 2017
- Probabilistic anomaly detection in natural gas time series dataInternational Journal of Forecasting, 2016
- A fast MST-inspired kNN-based outlier detection methodInformation Systems, 2015
- Time series outlier detection and imputation2014
- From Landscape to Portrait: A New Approach for Outlier Detection in Load Curve DataIEEE Transactions on Smart Grid, 2014
- Effects of Countdown Signals in Red Phase on Drivers: A Comparative Study between Japan and TurkeyMathematical Problems in Engineering, 2014
- Support Vector Machines Based on K Nearest Neighbor Algorithm for Outlier Detection in WSNs2012
- Anomaly detection in streaming environmental sensor data: A data-driven modeling approachEnvironmental Modelling & Software, 2010