Markov Chain Monte Carlo Methods for Lattice Gaussian Sampling: Convergence Analysis and Enhancement
Author:
- 2 July 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 67 (10) , 6711-6724
Abstract
Sampling from lattice Gaussian distribution has emerged as an important problem in coding, decoding and cryptography. In this paper, the classic Gibbs algorithm from Markov chain Monte Carlo (MCMC) methods is demonstrated to be geometrically ergodic for lattice Gaussian sampling, which means the Markov chain arising from it converges exponentially fast to the stationary distribution. Meanwhile, the exponential convergence rate of Markov chain is also derived through the spectral radius of forward operator. Then, a comprehensive analysis of the convergence rate is carried out and two sampling schemes are proposed to further enhance the convergence performance. The first one, referred to as Metropolis-within-Gibbs (MWG) algorithm, improves the convergence by refining the state space of the univariate sampling. The second is a blocked strategy of Gibbs algorithm, which performs sampling over multivariates at each Markov move, and is shown to yield a better convergence rate than the traditional univariate sampling. In order to perform blocked sampling efficiently, Gibbs-Klein (GK) algorithm is proposed, which samples block by block using Klein!/s algorithm. Furthermore, the validity of GK algorithm is demonstrated by showing its ergodicity. Simulation results based on MIMO detections are presented to confirm the convergence gain brought by the proposed Gibbs sampling schemes.Keywords
All Related Versions
This publication has 52 references indexed in Scilit:
- Geometric ergodicity and the spectral gap of non-reversible Markov chainsProbability Theory and Related Fields, 2011
- On lattices, learning with errors, random linear codes, and cryptographyJournal of the ACM, 2009
- General state space Markov chains and MCMC algorithmsProbability Surveys, 2004
- Ordering and Improving the Performance of Monte Carlo Markov ChainsStatistical Science, 2001
- Miscellanea. Peskun's theorem and a modified discrete-state Gibbs samplerBiometrika, 1996
- Annealing Markov Chain Monte Carlo with Applications to Ancestral InferenceJournal of the American Statistical Association, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Optimal nonuniform signaling for Gaussian channelsIEEE Transactions on Information Theory, 1993
- Eigenvalue Bounds on Convergence to Stationarity for Nonreversible Markov Chains, with an Application to the Exclusion ProcessThe Annals of Applied Probability, 1991
- Multidimensional constellations. II. Voronoi constellationsIEEE Journal on Selected Areas in Communications, 1989