Learning Differentiable Particle Filter on the Fly
Preprint
Abstract
Differentiable particle filters are an emerging class of sequential Bayesian inference techniques that use neural networks to construct components in state space models. Existing approaches are mostly based on offline supervised training strategies. This leads to the delay of the model deployment and the obtained filters are susceptible to distribution shift of test-time data. In this paper, we propose an online learning framework for differentiable particle filters so that model parameters can be updated as data arrive. The technical constraint is that there is no known ground truth state information in the online inference setting. We address this by adopting an unsupervised loss to construct the online model updating procedure, which involves a sequence of filtering operations for online maximum likelihood-based parameter estimation. We empirically evaluate the effectiveness of the proposed method, and compare it with supervised learning methods in simulation settings including a multivariate linear Gaussian state-space model and a simulated object tracking experiment.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Unsupervised Learning of Sampling Distributions for Particle FiltersIEEE Transactions on Signal Processing, 2023
- Hybrid Particle Filter–Particle Swarm Optimization Algorithm and Application to Fuzzy Controlled Servo SystemsIEEE Transactions on Fuzzy Systems, 2022
- Nested particle filters for online parameter estimation in discrete-time state-space Markov modelsBernoulli, 2018
- Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors2018
- On Particle Methods for Parameter Estimation in State-Space ModelsStatistical Science, 2015
- SMC2: An Efficient Algorithm for Sequential Analysis of State Space ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2012
- Particle Markov Chain Monte Carlo MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2010
- An Overview of Sequential Monte Carlo Methods for Parameter Estimation in General State-Space ModelsIFAC Proceedings Volumes, 2009
- Performance comparison of EKF and particle filtering methods for maneuvering targetsDigital Signal Processing, 2007
- On sequential Monte Carlo sampling methods for Bayesian filteringStatistics and Computing, 2000