Extending Gaussian process emulation using cluster analysis and artificial neural networks to fit big training sets
- 3 July 2018
- journal article
- research article
- Published by Taylor & Francis in Journal of Simulation
- Vol. 13 (3) , 195-208
Abstract
Gaussian process (GP) emulation is a relatively recent statistical technique that provides a fast-running approximation to a complex computer model, given training data generated by the considered model. Despite its sound theoretical foundation, GP emulation falls short in practical applications where the training dataset is very large, due to numerical instabilities in inverting the correlation matrix. We show how GP emulation can be extended to handle large training sets by first dividing the training set into smaller subsets using cluster analysis, then training an emulator for each subset, and finally combining the emulators using an artificial neural network (ANN). Our work has also conceptual relevance, as it shows how to solve a big data problem by introducing a local level in input space, where each emulator specialises in a certain subregion, and a global level, where the identified local features of the computer model are combined into a global view.Keywords
This publication has 28 references indexed in Scilit:
- The Effect of Gender Policies on Fertility: The Moderating Role of Education and Normative ContextEuropean Journal of Population, 2016
- From big data analysis to personalized medicine for all: challenges and opportunitiesBMC Medical Genomics, 2015
- Does Fertility Behavior Spread among Friends?American Sociological Review, 2014
- Social networks and fertilityDemographic Research, 2014
- Experimental design for the validation of kriging metamodels in computer experimentsJournal of Simulation, 2013
- Bayesian emulation of complex multi-output and dynamic computer modelsJournal of Statistical Planning and Inference, 2010
- Diagnostics for Gaussian Process EmulatorsTechnometrics, 2009
- Gaussian Predictive Process Models for Large Spatial Data SetsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Agent-Based Computational Modelling2006
- Agent-Based Computational Demography2003