Jarzyski's equality and Crooks' fluctuation theorem for general Markov chains with application to decision-making systems
Authors:
- Pedro HackPHPedro Hack
- Sebastian GottwaldSGSebastian Gottwald
- Daniel A. BraunDBDaniel A. Braun
Preprint
Abstract
We define common thermodynamic concepts purely within the framework of general Markov chains and derive Jarzynski's equality and Crooks' fluctuation theorem in this setup. In particular, we regard the discrete time case that leads to an asymmetry in the definition of work that appears in the usual formulation of Crooks' fluctuation theorem. We show how this asymmetry can be avoided with an additional condition regarding the energy protocol. The general formulation in terms of Markov chains allows transferring the results to other application areas outside of physics. Here, we discuss how this framework can be applied in the context of decision-making. This involves the definition of the relevant quantities, the assumptions that need to be made for the different fluctuation theorems to hold, as well as the consideration of discrete trajectories instead of the continuous trajectories, which are relevant in physics.Keywords
All Related Versions
- Version 1, 2022-02-11, ArXiv
- Version 2, 2022-11-25, ArXiv
- Published version: Entropy, 24 (12), 1731.
This publication has 23 references indexed in Scilit:
- Thermodynamic fluctuation theorems govern human sensorimotor learningScientific Reports, 2023
- Markov blankets, information geometry and stochastic thermodynamicsPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2019
- Verification of the quantum nonequilibrium work relation in the presence of decoherenceNew Journal of Physics, 2018
- Dissipative adaptation in driven self-assemblyNature Nanotechnology, 2015
- Thermodynamics as a theory of decision-making with information-processing costsProceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2013
- Stochastic thermodynamics, fluctuation theorems and molecular machinesReports on Progress in Physics, 2012
- Stochastic theory of nonequilibrium steady states and its applications. Part IPhysics Reports, 2012
- Generalized Jarzynski’s equality in inhomogeneous Markov chainsJournal of Mathematical Physics, 2007
- Verification of the Crooks fluctuation theorem and recovery of RNA folding free energiesNature, 2005
- Majorization and divergenceJournal of Mathematical Analysis and Applications, 1990