A Methodology for Joint Data Cleaning of Solar Photovoltaic Generation and Solar Irradiation
Authors:
- 1 August 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
A good solar power photovoltaic generation forecast depends on good quality time series data from measurements of global horizontal irradiation and solar generation. However, measurement system failures and errors in data handling can corrupt data records with gaps and outliers that undermine forecasting accuracy. Therefore, it is important that the fitting of solar energy prediction models must be preceded by a data analysis in order to detect and correct measurement errors. This paper presents the main features of an approach for the joint data cleaning of solar photovoltaic generation and solar irradiation. The methodology comprises 5 chained steps and consists in the combined treatment of global horizontal irradiation and solar photovoltaic generation data using statistical techniques, data mining algorithms and reanalysis data with the purpose of correcting outliers, replacing incorrect values and filling data gaps. The application of the proposed approach is illustrated with a real system presenting good performance.Keywords
This publication has 11 references indexed in Scilit:
- Data Cleaning Method Based on Time Series Similarity Measurement for Large-Scale Smart Grid Load Data2017
- Photovoltaic Generation Data Cleaning Method Based on Approximately Periodic Time SeriesIOP Conference Series: Earth and Environmental Science, 2017
- Long-term patterns of European PV output using 30 years of validated hourly reanalysis and satellite dataEnergy, 2016
- Reanalyses and Observations: What’s the Difference?Bulletin of the American Meteorological Society, 2016
- Data on photovoltaic power forecasting models for Mediterranean climateData in Brief, 2016
- Error analysis of hybrid photovoltaic power forecasting models: A case study of mediterranean climateEnergy Conversion and Management, 2015
- Chronological simulation of the interaction between intermittent generation and distribution network2013
- Comparisons Among Clustering Techniques for Electricity Customer ClassificationIEEE Transactions on Power Systems, 2006
- Self-Organization and Associative Memory1989
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979