Learning and inference in a nonequilibrium Ising model with hidden nodes
- 20 February 2013
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 87 (2) , 022127
Abstract
We study inference and reconstruction of couplings in a partially observed kinetic Ising model. With hidden spins, calculating the likelihood of a sequence of observed spin configurations requires performing a trace over the configurations of the hidden ones. This, as we show, can be represented as a path integral. Using this representation, we demonstrate that systematic approximate inference and learning rules can be derived using dynamical mean-field theory. Although naive mean-field theory leads to an unstable learning rule, taking into account Gaussian corrections allows learning the couplings involving hidden nodes. It also improves learning of the couplings between the observed nodes compared to when hidden nodes are ignored.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Mean-Field Theory for the Inverse Ising Problem at Low TemperaturesPhysical Review Letters, 2012
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methodsJournal of Statistical Mechanics: Theory and Experiment, 2012
- Bethe–Peierls approximation and the inverse Ising problemJournal of Statistical Mechanics: Theory and Experiment, 2012
- Exact mean-field inference in asymmetric kinetic Ising systemsJournal of Statistical Mechanics: Theory and Experiment, 2011
- Network inference using asynchronously updated kinetic Ising modelPhysical Review E, 2011
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy DataPhysical Review Letters, 2011
- Mean Field Theory for Nonequilibrium Network ReconstructionPhysical Review Letters, 2011
- Statistical physics of pairwise probability modelsFrontiers in Computational Neuroscience, 2009
- Mean-field theory of Boltzmann machine learningPhysical Review E, 1998
- Efficient Learning in Boltzmann Machines Using Linear Response TheoryNeural Computation, 1998