Missing data in spatiotemporal datasets: the UK rainfall chemistry network
Authors:
Open Access
- 1 April 2015
- journal article
- research article
- Published by Wiley in Geoscience Data Journal
- Vol. 2 (1) , 25-30
Abstract
Rainfall chemistry networks inevitably report some missing data, caused by contamination or loss of samples. However, there are no universally accepted rules about how such data, particularly from samples contaminated in the field, are identified and reported, leading to uncertainties in data usage by third parties, and possible incorrect inferences based on the reported data. This paper describes how the UK rainfall chemistry network data have been analysed for contamination, and how missing values can be estimated based on cross‐correlations in time and space, using data from 20 sites over 26 years. The final flagged dataset is available through the CEH Environmental Information Data Centre (EIDC). Erroneous data values are identified through consideration of ion balance (internal consistency), and evidence of contamination by birds or windblown dust based on the reported chemical analysis. Overall data capture with the erroneous data excluded and no replacement of missing data was 86%, but with much smaller data capture at some sites in some years, to <30% in some cases. The use of estimated data to replace missing values resulted in an increase in overall data capture to 96%, with only one site having data capture <70% in an individual year, and all sites achieving a data capture of 88% or more over the full period. The implications of using the reported ‘official’ annual data, as opposed to the dataset with missing values replaced by estimates, are illustrated by consideration of the temporal trend in nitrate at one site, which shows twice the value in the ‘official’ reported annual data compared with the ‘estimated’ data, part of a consistent pattern across all sites. Use of the uncorrected ‘raw’ sample data leads to large errors.Keywords
Funding Information
- Natural Environment Research Council (NEC4100)
- UK Department of Environment Food and Rural Affairs (AQ0720)
This publication has 8 references indexed in Scilit:
- A global assessment of precipitation chemistry and deposition of sulfur, nitrogen, sea salt, base cations, organic acids, acidity and pH, and phosphorusAtmospheric Environment, 2014
- Data loss from time series of pollutants in ambient air exhibiting seasonality: consequences and strategies for data predictionEnvironmental Science: Processes & Impacts, 2013
- Introduction to the European Monitoring and Evaluation Programme (EMEP) and observed atmospheric composition change during 1972–2009Atmospheric Chemistry and Physics, 2012
- Long Term Trends in Sulphur and Nitrogen Deposition in Europe and the Cause of Non-linearitiesWater, Air, & Soil Pollution: Focus, 2007
- Field intercomparison of precipitation measurements performed within the framework of the Pan European Intensive Monitoring Program of EU/ICP ForestEnvironmental Pollution, 2003
- Wet and Dry Deposition of Sulfur at Hubbard Brook1980
- The collection of precipitation for chemical analysisTellus, 1978
- Calibration of collection procedures for the determination of precipitation chemistryWater, Air, & Soil Pollution, 1976