Understanding and assessing uncertainty of observational climate datasets for model evaluation using ensembles
Open Access
- 31 May 2020
- journal article
- review article
- Published by Wiley in Wires Climate Change
- Vol. 11 (5)
Abstract
In climate science, observational gridded climate datasets that are based on in situ measurements serve as evidence for scientific claims and they are used to both calibrate and evaluate models. However, datasets only represent selected aspects of the real world, so when they are used for a specific purpose they can be a source of uncertainty. Here, we present a framework for understanding this uncertainty of observational datasets which distinguishes three general sources of uncertainty: (1) uncertainty that arises during the generation of the dataset; (2) uncertainty due to biased samples; and (3) uncertainty that arises due to the choice of abstract properties, such as resolution and metric. Based on this framework, we identify four different types of dataset ensembles—parametric, structural, resampling, and property ensembles—as tools to understand and assess uncertainties arising from the use of datasets for a specific purpose. We advocate for a more systematic generation of dataset ensembles by using these sorts of tools. Finally, we discuss the use of dataset ensembles in climate model evaluation. We argue that a more systematic understanding and assessment of dataset uncertainty is needed to allow for a more reliable uncertainty assessment in the context of model evaluation. The more systematic use of such a framework would be beneficial for both scientific reasoning and scientific policy advice based on climate datasets.This article is categorized under:Paleoclimates and Current Trends > Modern Climate ChangeKeywords
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (167215)
This publication has 77 references indexed in Scilit:
- Robustness and uncertainties in the new CMIP5 climate model projectionsNature Climate Change, 2012
- GLOBAL SURFACE TEMPERATURE CHANGEReviews of Geophysics, 2010
- Homogenization of Temperature Series via Pairwise ComparisonsJournal of Climate, 2009
- A Review of Uncertainties in Global Temperature Projections over the Twenty-First CenturyJournal of Climate, 2008
- A large discontinuity in the mid-twentieth century in observed global-mean surface temperatureNature, 2008
- The use of the multi-model ensemble in probabilistic climate projectionsPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2007
- Some varieties of robustnessJournal of Economic Methodology, 2006
- Uncertainty in predictions of the climate response to rising levels of greenhouse gasesNature, 2005
- Warming of the World OceanScience, 2000
- The Jackknife Estimate of VarianceThe Annals of Statistics, 1981