REDS: Random ensemble deep spatial prediction
- 2 December 2022
- journal article
- research article
- Published by Wiley in Environmetrics
- Vol. 34 (1)
Abstract
There has been a great deal of recent interest in the development of spatial prediction algorithms for very large datasets and/or prediction domains. These methods have primarily been developed in the spatial statistics community, but there has been growing interest in the machine learning community for such methods, primarily driven by the success of deep Gaussian process regression approaches and deep convolutional neural networks. These methods are often computationally expensive to train and implement and consequently, there has been a resurgence of interest in random projections and deep learning models based on random weights—so called reservoir computing methods. Here, we combine several of these ideas to develop the random ensemble deep spatial (REDS) approach to predict spatial data. The procedure uses random Fourier features as inputs to an extreme learning machine (a deep neural model with random weights), and with calibrated ensembles of outputs from this model based on different random weights, it provides a simple uncertainty quantification. The REDS method is demonstrated on simulated data and on a classic large satellite data set.Keywords
All Related Versions
Funding Information
- National Science Foundation (SES‐1853096, CNS‐1429294)
This publication has 47 references indexed in Scilit:
- Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix DecompositionsSIAM Review, 2011
- Covariance Tapering for Likelihood-Based Estimation in Large Spatial Data SetsJournal of the American Statistical Association, 2008
- Gaussian Predictive Process Models for Large Spatial Data SetsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Fixed Rank Kriging for Very Large Spatial Data SetsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Strictly Proper Scoring Rules, Prediction, and EstimationJournal of the American Statistical Association, 2007
- Covariance Tapering for Interpolation of Large Spatial DatasetsJournal of Computational and Graphical Statistics, 2006
- Bagging predictorsMachine Learning, 1996
- Learning and generalization characteristics of the random vector functional-link netNeurocomputing, 1994
- Backpropagation and stochastic gradient descent methodNeurocomputing, 1993
- An algorithm with guaranteed convergence for finding a zero of a functionThe Computer Journal, 1971