Performance of Hamiltonian Monte Carlo and No-U-Turn Sampler for estimating genetic parameters and breeding values
Open Access
- 10 December 2019
- journal article
- research article
- Published by Springer Nature in Genetics Selection Evolution
- Vol. 51 (1) , 1-12
Abstract
Background: Hamiltonian Monte Carlo is one of the algorithms of the Markov chain Monte Carlo method that uses Hamiltonian dynamics to propose samples that follow a target distribution. The method can avoid the random walk behavior to achieve a more effective and consistent exploration of the probability space and sensitivity to correlated parameters, which are shortcomings that plague many Markov chain Monte Carlo methods. However, the performance of Hamiltonian Monte Carlo is highly sensitive to two hyperparameters. The No-U-Turn Sampler, an extension of Hamiltonian Monte Carlo, was recently introduced to automate the tuning of these hyperparameters. Thus, this study compared the performances of Gibbs sampling, Hamiltonian Monte Carlo, and the No-U-Turn Sampler for estimating genetic parameters and breeding values as well as sampling qualities in both simulated and real pig data. For all datasets, we used a pedigree-based univariate linear mixed model. Results: For all datasets, the No-U-Turn Sampler and Gibbs sampling performed comparably regarding the estimation of heritabilities and accuracies of breeding values. Compared with Gibbs sampling, the estimates of effective sample sizes for simulated and pig data with the No-U-Turn Sampler were 3.2 to 22.6 and 3.5 to 5.9 times larger, respectively. Autocorrelations decreased more quickly with the No-U-Turn Sampler than with Gibbs sampling. When true heritability was low in the simulated data, the skewness of the marginal posterior distributions with the No-U-Turn Sampler was smaller than that with Gibbs sampling. The performance of Hamiltonian Monte Carlo for sampling quality was inferior to that of No-U-Turn Sampler in the simulated data. Moreover, Hamiltonian Monte Carlo could not estimate genetic parameters because of difficulties with the hyperparameter settings with pig data. Conclusions: The No-U-Turn Sampler is a promising sampling method for animal breeding because of its good sampling qualities: large effective sample sizes, low autocorrelations, and low skewness of marginal posterior distributions, particularly when heritability is low. Meanwhile, Hamiltonian Monte Carlo failed to converge with a simple univariate model for pig data. Thus, it might be difficult to use Hamiltonian Monte Carlo for usual complex models in animal breeding.Keywords
This publication has 20 references indexed in Scilit:
- Riemann Manifold Langevin and Hamiltonian Monte Carlo MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2011
- QMSim: a large-scale genome simulator for livestockBioinformatics, 2009
- Selection for Environmental Variation: A Statistical Analysis and Power Calculations to Detect ResponseGenetics, 2008
- Primal-dual subgradient methods for convex problemsMathematical Programming, 2007
- Slice samplingThe Annals of Statistics, 2003
- A Bayesian analysis of the effect of selection for growth rate on growth curves in rabbitsGenetics Selection Evolution, 2003
- Bayesian analysis of genetic change due to selection using Gibbs samplingGenetics Selection Evolution, 1994
- Bayesian analysis of mixed linear models via Gibbs sampling with an application to litter size in Iberian pigsGenetics Selection Evolution, 1994
- Marginal inferences about variance components in a mixed linear model using Gibbs samplingGenetics Selection Evolution, 1993
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990