Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction
Open Access
- 6 June 2023
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 11 (12) , 2592
Abstract
As a reasonable statistical learning model for curve clustering analysis, the two-layer mixtures of Gaussian process functional regressions (TMGPFR) model has been developed to fit the data of sample curves from a number of independent information sources or stochastic processes. Since the sample curves from a certain stochastic process naturally form a curve cluster, the model selection of TMGPFRs, i.e., the selection of the number of mixtures of Gaussian process functional regressions (MGPFRs) in the upper layer, corresponds to the discovery of the cluster number and structure of the curve data. In fact, this is rather challenging because the conventional model selection criteria, such as BIC and cross-validation, cannot lead to a stable result in practice even with a heavy burden of repetitive computation. In this paper, we improve the original TMGPFR model and propose a Bayesian Ying-Yang (BYY) annealing learning algorithm for the parameter learning of the improved model with automated model selection. The experimental results of both synthetic and realistic datasets demonstrate that our proposed algorithm can make correct model selection automatically during parameter learning of the model.Keywords
Funding Information
- National Key Research and Development Program of China (2018AAA0100205)
This publication has 30 references indexed in Scilit:
- Curve prediction and clustering with mixtures of Gaussian process functional regression modelsStatistics and Computing, 2008
- The BYY annealing learning algorithm for Gaussian mixture with automated model selectionPattern Recognition, 2007
- Gaussian Process Functional Regression Modeling for Batch DataBiometrics, 2007
- Bayesian Ying Yang learningScholarpedia, 2007
- Hierarchical Gaussian process mixtures for regressionStatistics and Computing, 2005
- Learning a multivariate Gaussian mixture model with the reversible jump MCMC algorithmStatistics and Computing, 2004
- Best Harmony, Unified RPCL and Automated Model Selection for Unsupervised and Supervised Learning on Gaussian Mixtures, Three-Layer Nets and ME-RBF-SVM ModelsInternational Journal of Neural Systems, 2001
- Long Short-Term MemoryNeural Computation, 1997
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- A Bayesian Analysis of Some Nonparametric ProblemsThe Annals of Statistics, 1973