A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm
Authors:
- 5 January 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 29 (10) , 4894-4904
Abstract
The mixture of Gaussian processes (GPs) is capable of learning any general stochastic process based on a given set of (sample) curves for the regression and prediction problems. However, it is ineffective for curve clustering and prediction, when the sample curves are derived from different stochastic processes as independent sources linearly mixed together. In this paper, we propose a two-layer mixture model of GP functional regressions (GPFRs) to describe such a mixture of general stochastic processes or independent sources, especially for curve clustering and prediction. Specifically, in the lower layer, the mixture of GPFRs (MGPFRs) is developed for a cluster (or class) of curves within the input space . In the higher layer, the mixture of MGPFRs is further established to divide the curves into clusters according to its components in the output space . For the parameter estimation of the two-layer mixture of GPFRs, we develop a Monte Carlo EM algorithm based on a Monte Carlo Markov chain (MCMC) method, in short, the MCMC EM algorithm. We validate the hierarchical mixture of GPFRs and MCMC EM algorithm using synthetic and real-world data sets. Our results show that our new model outperforms the conventional mixture models in curve clustering and prediction.Keywords
Funding Information
- National Natural Science Foundation of China (61171138)
This publication has 21 references indexed in Scilit:
- Asymptotic Convergence Properties of the EM Algorithm for Mixture of ExpertsNeural Computation, 2011
- A survey of cross-validation procedures for model selectionStatistics Surveys, 2010
- On the Concept of Depth for Functional DataJournal of the American Statistical Association, 2009
- Curve prediction and clustering with mixtures of Gaussian process functional regression modelsStatistics and Computing, 2008
- The BYY annealing learning algorithm for Gaussian mixture with automated model selectionPattern Recognition, 2007
- Gaussian Process Functional Regression Modeling for Batch DataBiometrics, 2007
- Nonlinear modeling of FES-supported standing-up in paraplegia for selection of feedback sensorsIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2005
- Asymptotic Convergence Rate of the EM Algorithm for Gaussian MixturesNeural Computation, 2000
- A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation AlgorithmsJournal of the American Statistical Association, 1990
- On calculating with B-splinesJournal of Approximation Theory, 1972