Learning thermodynamics with Boltzmann machines
Authors:
Top Cited Papers
- 17 October 2016
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review B
- Vol. 94 (16) , 165134
Abstract
A Boltzmann machine is a stochastic neural network that has been extensively used in the layers of deep architectures for modern machine learning applications. In this paper, we develop a Boltzmann machine that is capable of modeling thermodynamic observables for physical systems in thermal equilibrium. Through unsupervised learning, we train the Boltzmann machine on data sets constructed with spin configurations importance sampled from the partition function of an Ising Hamiltonian at different temperatures using Monte Carlo (MC) methods. The trained Boltzmann machine is then used to generate spin states, for which we compare thermodynamic observables to those computed by direct MC sampling. We demonstrate that the Boltzmann machine can faithfully reproduce the observables of the physical system. Further, we observe that the number of neurons required to obtain accurate results increases as the system is brought close to criticality.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada
- Ministry of Research and Innovation
This publication has 10 references indexed in Scilit:
- A structural approach to relaxation in glassy liquidsNature Physics, 2016
- Deep learningNature, 2015
- Searching for exotic particles in high-energy physics with deep learningNature Communications, 2014
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- An Efficient Learning Procedure for Deep Boltzmann MachinesNeural Computation, 2012
- Learning multiple layers of representationTrends in Cognitive Sciences, 2007
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Crystal Statistics. I. A Two-Dimensional Model with an Order-Disorder TransitionPhysical Review B, 1944
- Statistics of the Two-Dimensional Ferromagnet. Part IPhysical Review B, 1941