Monte Carlo Simulation on the Stiefel Manifold via Polar Expansion
Authors:
- 1 February 2021
- journal article
- research article
- Published by Taylor & Francis in Journal of Computational and Graphical Statistics
- Vol. 30 (3) , 622-631
Abstract
Motivated by applications to Bayesian inference for statistical models with orthogonal matrix parameters, we present polar expansion, a general approach to Monte Carlo simulation from probability distributions on the Stiefel manifold. To bypass many of the well-established challenges of simulating from the distribution of a random orthogonal matrix we construct a distribution for an unconstrained random matrix such that the orthogonal component of the polar decomposition of is equal in distribution to The distribution of is amenable to Markov chain Monte Carlo (MCMC) simulation using standard methods, and an approximation to the distribution of can be recovered from a Markov chain on the unconstrained space. When combined with modern MCMC software, polar expansion allows for routine and flexible posterior inference in models with orthogonal matrix parameters. We find that polar expansion with adaptive Hamiltonian Monte Carlo is an order of magnitude more efficient than competing MCMC approaches in a benchmark protein interaction network application. We also propose a new approach to Bayesian functional principal component analysis which we illustrate in a meteorological time series application.
Keywords
All Related Versions
Funding Information
- Office of Naval Research
This publication has 28 references indexed in Scilit:
- Estimating the Correlation in Bivariate Normal Data With Known Variances and Small Sample SizesThe American Statistician, 2012
- MCMC Using Hamiltonian Dynamics2011
- Interaction network containing conserved and essential protein complexes in Escherichia coliNature, 2005
- Parameter Expansion for Data AugmentationJournal of the American Statistical Association, 1999
- Parameter expansion to accelerate EM: the PX-EM algorithmBiometrika, 1998
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Hybrid Monte CarloPhysics Letters B, 1987
- Some matrix-variate distribution theory: Notational considerations and a Bayesian applicationBiometrika, 1981
- Choosing a Point from the Surface of a SphereThe Annals of Mathematical Statistics, 1972
- Normal Multivariate Analysis and the Orthogonal GroupThe Annals of Mathematical Statistics, 1954