Planning to avoid ambiguous states through Gaussian approximations to non-linear sensors in active inference agents
Author:
Preprint
Abstract
In nature, active inference agents must learn how observations of the world represent the state of the agent. In engineering, the physics behind sensors is often known reasonably accurately and measurement functions can be incorporated into generative models. When a measurement function is non-linear, the transformed variable is typically approximated with a Gaussian distribution to ensure tractable inference. We show that Gaussian approximations that are sensitive to the curvature of the measurement function, such as a second-order Taylor approximation, produce a state-dependent ambiguity term. This induces a preference over states, based on how accurately the state can be inferred from the observation. We demonstrate this preference with a robot navigation experiment where agents plan trajectories.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Whence the Expected Free Energy?Neural Computation, 2021
- Active inference on discrete state-spaces: A synthesisJournal of Mathematical Psychology, 2020
- Learning action-oriented models through active inferencePLOS Computational Biology, 2020
- Active Inference: A Process TheoryNeural Computation, 2017
- Active inference and epistemic valueCognitive Neuroscience, 2015
- Some Relations Between Extended and Unscented Kalman FiltersIEEE Transactions on Signal Processing, 2011
- The free-energy principle: a unified brain theory?Nature Reviews Neuroscience, 2010
- Recursive Noise Adaptive Kalman Filtering by Variational Bayesian ApproximationsIEEE Transactions on Automatic Control, 2009
- Unscented Filtering and Nonlinear EstimationProceedings of the IEEE, 2004
- Every good regulator of a system must be a model of that system †International Journal of Systems Science, 1970