Latent variable estimation with composite Hilbert space Gaussian processes
Authors:
Preprint
Abstract
We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent variable inference under a single probabilistic framework. Similarly specified exact Gaussian processes scale poorly with large datasets. To overcome this, we extend the recently developed Hilbert space approximation methods for Gaussian processes to obtain a reduced-rank representation of the composite covariance function through its spectral decomposition. Specifically, we derive and analyze the spectral decomposition of derivative covariance functions and further study their properties theoretically. Using these spectral decompositions, our methods easily scale up to data scenarios involving thousands of samples. We validate our methods in terms of latent variable estimation accuracy, uncertainty calibration, and inference speed across diverse simulation scenarios. Finally, using a real world case study from single-cell biology, we demonstrate the potential of our models in estimating latent cellular ordering given gene expression levels, thus enhancing our understanding of the underlying biological process.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Hilbert space methods for approximating multi-output latent variable Gaussian processesStatistics and Computing, 2026
- DGP-LVM: Derivative Gaussian process latent variable modelsStatistics and Computing, 2025
- Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programmingStatistics and Computing, 2022
- Graphical test for discrete uniformity and its applications in goodness-of-fit evaluation and multiple sample comparisonStatistics and Computing, 2022
- Hilbert space methods for reduced-rank Gaussian process regressionStatistics and Computing, 2019
- RNA velocity of single cellsNature, 2018
- Computational analysis of cell-to-cell heterogeneity in single-cell RNA-sequencing data reveals hidden subpopulations of cellsNature Biotechnology, 2015
- The dynamics and regulators of cell fate decisions are revealed by pseudotemporal ordering of single cellsNature Biotechnology, 2014
- Generating random correlation matrices based on vines and extended onion methodJournal of Multivariate Analysis, 2009
- Linear Theory of Random Processes2004