Fast methods for training Gaussian processes on large datasets
Open Access
- 1 May 2016
- journal article
- research article
- Published by The Royal Society in Royal Society Open Science
- Vol. 3 (5) , 160125
Abstract
Gaussian process regression (GPR) is a non-parametric Bayesian technique for interpolating or fitting data. The main barrier to further uptake of this powerful tool rests in the computational costs associated with the matrices which arise when dealing with large datasets. Here, we derive some simple results which we have found useful for speeding up the learning stage in the GPR algorithm, and especially for performing Bayesian model comparison between different covariance functions. We apply our techniques to both synthetic and real data and quantify the speed-up relative to using nested sampling to numerically evaluate model evidences.Keywords
All Related Versions
Funding Information
- Cambridge Commonwealth, European and International Trust
This publication has 20 references indexed in Scilit:
- Understanding predictive information criteria for Bayesian modelsStatistics and Computing, 2013
- A review of Bayesian variable selection methods: what, how and whichBayesian Analysis, 2009
- Multimodal nested sampling: an efficient and robust alternative to Markov Chain Monte Carlo methods for astronomical data analysesMonthly Notices of the Royal Astronomical Society, 2008
- Fixed Rank Kriging for Very Large Spatial Data SetsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Nested sampling for general Bayesian computationBayesian Analysis, 2006
- Comparison of Approximate Methods for Handling HyperparametersNeural Computation, 1999
- Nonparametric Bayesian RegressionThe Annals of Statistics, 1986
- A Predictive Approach to Model SelectionJournal of the American Statistical Association, 1979
- A Predictive Approach to Model SelectionJournal of the American Statistical Association, 1979
- An invariant form for the prior probability in estimation problemsProceedings of the Royal Society of London. A. Mathematical and Physical Sciences, 1946