Entropy Production in Stochastics
Open Access
Abstract
While the modern definition of entropy is genuinely probabilistic, in entropy production the classical thermodynamic definition, as in heat transfer, is typically used. Here we explore the concept of entropy production within stochastics and, particularly, two forms of entropy production in logarithmic time, unconditionally (EPLT) or conditionally on the past and present having been observed (CEPLT). We study the theoretical properties of both forms, in general and in application to a broad set of stochastic processes. A main question investigated, related to model identification and fitting from data, is how to estimate the entropy production from a time series. It turns out that there is a link of the EPLT with the climacogram, and of the CEPLT with two additional tools introduced here, namely the differenced climacogram and the climacospectrum. In particular, EPLT and CEPLT are related to slopes of log-log plots of these tools, with the asymptotic slopes at the tails being most important as they justify the emergence of scaling laws of second-order characteristics of stochastic processes. As a real-world application, we use an extraordinary long time series of turbulent velocity and show how a parsimonious stochastic model can be identified and fitted using the tools developed.Keywords
This publication has 34 references indexed in Scilit:
- How physicists disagree on the meaning of entropyAmerican Journal of Physics, 2011
- HESS Opinions "A random walk on water"Hydrology and Earth System Sciences, 2010
- Irreversibility and Fluctuation Theorem in Stationary Time SeriesPhysical Review Letters, 2007
- The second law of thermodynamics and the global climate system: A review of the maximum entropy production principleReviews of Geophysics, 2003
- Decaying turbulence in an active-grid-generated flow and comparisons with large-eddy simulationJournal of Fluid Mechanics, 2003
- Wavelet-based representations for the 1/f family of fractal processesProceedings of the IEEE, 1993
- Principle of maximum entropy in hydrologic frequency analysisJournal of Hydrology, 1972
- PARAMETER ESTIMATION IN HYDROLOGY: THE STATE OF THE ART1Jawra Journal of the American Water Resources Association, 1971
- Underlining random variables*Statistica Neerlandica, 1966
- Information Theory and Statistical MechanicsPhysical Review B, 1957