A Non-Negative Measure of Information for Continuous Probability Distributions
Open Access
- 30 June 2026
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 14 (13) , 2311
Abstract
In this work, we investigate the possibility of using varentropy, an information measure previously proposed for discrete probability distribution, as a measure of the probabilistic uncertainty of continuous probability distribution. We show that varentropy allows avoiding negative values and some undesirable features of informational entropy encountered while using the Boltzmann–Shannon formula (and others) for continuous probability distributions.Keywords
This publication has 17 references indexed in Scilit:
- Derivation of the maximum entropy principle from the virtual work principleThe European Physical Journal Plus, 2025
- Principle of maximum caliber and quantum physicsPhysical Review E, 2018
- Hamiltonian formalism and path entropy maximizationJournal of Physics A: Mathematical and Theoretical, 2015
- Path probability distribution of stochastic motion of non dissipative systems: a classical analog of Feynman factor of path integralChaos, Solitons & Fractals, 2013
- DOUBLE POWER-LAW DEGREE DISTRIBUTION AND INFORMATIONAL ENTROPY IN URBAN ROAD NETWORKSInternational Journal of Modern Physics C, 2011
- Properness and Widely Linear Processing of Quaternion Random VectorsIEEE Transactions on Information Theory, 2010
- Probability distribution and entropy as a measure of uncertaintyJournal of Physics A: Mathematical and Theoretical, 2008
- Generalized entropy optimized by a given arbitrary distributionJournal of Physics A: General Physics, 2003
- Gibbs vs Boltzmann EntropiesAmerican Journal of Physics, 1965
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948