A Dynamical Systems-Based Hierarchy for Shannon, Metric and Topological Entropy
Open Access
Abstract
A rigorous dynamical systems-based hierarchy is established for the definitions of entropy of Shannon (information), Kolmogorov–Sinai (metric) and Adler, Konheim & McAndrew (topological). In particular, metric entropy, with the imposition of some additional properties, is proven to be a special case of topological entropy and Shannon entropy is shown to be a particular form of metric entropy. This is the first of two papers aimed at establishing a dynamically grounded hierarchy comprising Clausius, Boltzmann, Gibbs, Shannon, metric and topological entropy in which each element is ideally a special case of its successor or some kind of limit thereof.Keywords
This publication has 23 references indexed in Scilit:
- Category Theory for Autonomous and Networked Dynamical SystemsEntropy, 2019
- New and old facts about entropy in uniform spaces and topological groupsTopology and its Applications, 2012
- Entropy and UncertaintyEntropy, 2008
- Quantum and Ecosystem EntropiesEntropy, 2008
- Fifty years of entropy in dynamics: 1958--2007Journal of Modern Dynamics, 2007
- Relating Topological Entropy and Measure EntropyBulletin of the London Mathematical Society, 1971
- ON THE RELATIONS AMONG VARIOUS ENTROPY CHARACTERISTICS OF DYNAMICAL SYSTEMSMathematics of the USSR-Izvestiya, 1971
- Entropy for group endomorphisms and homogeneous spacesTransactions of the American Mathematical Society, 1971
- The product theorem for topological entropyTransactions of the American Mathematical Society, 1971
- Topological entropyTransactions of the American Mathematical Society, 1965