Estimating Distributions of Parameters in Nonlinear State Space Models with Replica Exchange Particle Marginal Metropolis–Hastings Method
Open Access
Abstract
Extracting latent nonlinear dynamics from observed time-series data is important for understanding a dynamic system against the background of the observed data. A state space model is a probabilistic graphical model for time-series data, which describes the probabilistic dependence between latent variables at subsequent times and between latent variables and observations. Since, in many situations, the values of the parameters in the state space model are unknown, estimating the parameters from observations is an important task. The particle marginal Metropolis–Hastings (PMMH) method is a method for estimating the marginal posterior distribution of parameters obtained by marginalization over the distribution of latent variables in the state space model. Although, in principle, we can estimate the marginal posterior distribution of parameters by iterating this method infinitely, the estimated result depends on the initial values for a finite number of times in practice. In this paper, we propose a replica exchange particle marginal Metropolis–Hastings (REPMMH) method as a method to improve this problem by combining the PMMH method with the replica exchange method. By using the proposed method, we simultaneously realize a global search at a high temperature and a local fine search at a low temperature. We evaluate the proposed method using simulated data obtained from the Izhikevich neuron model and Lévy-driven stochastic volatility model, and we show that the proposed REPMMH method improves the problem of the initial value dependence in the PMMH method, and realizes efficient sampling of parameters in the state space models compared with existing methods.Keywords
Funding Information
- Japan Society for the Promotion of Science (JP25120010, JP15KK0010,JP17H02923, JP19H04125, JP21H03509)
- Japan Science and Technology Agency (JPMJCR1755, JPMJCR1861, JPMJCR1914)
This publication has 35 references indexed in Scilit:
- A sequential Monte Carlo approach to estimate biophysical neural models from spikesJournal of Neural Engineering, 2011
- Fast Nonnegative Deconvolution for Spike Train Inference From Population Calcium ImagingJournal of Neurophysiology, 2010
- Particle Markov Chain Monte Carlo MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- Spike Inference from Calcium Imaging Using Sequential Monte Carlo MethodsBiophysical Journal, 2009
- Which Model to Use for Cortical Spiking Neurons?IEEE Transactions on Neural Networks, 2004
- Simple model of spiking neuronsIEEE Transactions on Neural Networks, 2003
- Fast Bayesian reconstruction of chaotic dynamical systems via extended Kalman filteringPhysical Review E, 2001
- Non-Gaussian Ornstein–Uhlenbeck-based Models and Some of Their Uses in Financial EconomicsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- A Self-Organizing State-Space ModelJournal of the American Statistical Association, 1998
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983