Autonomous learning of generative models with chemical reaction network ensembles
Open Access
- 22 January 2025
- journal article
- research article
- Published by The Royal Society in Journal of The Royal Society Interface
- Vol. 22 (222) , 20240373
Abstract
Can a micron-sized sack of interacting molecules autonomously learn an internal model of a complex and fluctuating environment? We draw insights from control theory, machine learning theory, chemical reaction network theory and statistical physics to develop a general architecture whereby a broad class of chemical systems can autonomously learn complex distributions. Our construction takes the form of a chemical implementation of machine learning’s optimization workhorse: gradient descent on the relative entropy cost function, which we demonstrate can be viewed as a form of integral feedback control. We show how this method can be applied to optimize any detailed balanced chemical reaction network and that the construction is capable of using hidden units to learn complex distributions.Keywords
All Related Versions
Funding Information
- National Science Foundation
This publication has 57 references indexed in Scilit:
- On the Complexity of Quadratization for Polynomial Differential Equations2020
- Future systems and control research in synthetic biologyAnnual Reviews in Control, 2018
- Conditions for extinction events in chemical reaction networks with discrete state spacesJournal of Mathematical Biology, 2017
- Chemical Boltzmann Machines2017
- Why Does Deep and Cheap Learning Work So Well?Journal of Statistical Physics, 2017
- Product-Form Stationary Distributions for Deficiency Zero Chemical Reaction NetworksBulletin of Mathematical Biology, 2010
- Computation with finite stochastic chemical reaction networksNatural Computing, 2008
- Predictive coding: an account of the mirror neuron systemCognitive Processing, 2007
- Calcium Homeostasis and Parturient Hypocalcemia: An Integral Feedback PerspectiveJournal of Theoretical Biology, 2002
- The internal model principle of control theoryAutomatica, 1976