Necessary and Sufficient Conditions for Characterizing Finite Discrete Distributions with Generalized Shannon's Entropy
Author:
Preprint
Abstract
This article establishes necessary and sufficient conditions under which a finite set of Generalized Shannon's Entropy (GSE) characterizes a finite discrete distribution up to permutation. For an alphabet of cardinality K, it is shown that K-1 distinct positive real orders of GSE are sufficient (and necessary if no multiplicity) to identify the distribution up to permutation. When the distribution has a known multiplicity structure with s distinct values, s-1 orders are sufficient and necessary. These results provide a label-invariant foundation for inference on unordered sample spaces and enable practical goodness-of-fit procedures across disparate alphabets. The findings also suggest new approaches for testing, estimation, and model comparison in settings where moment-based and link-based methods are inadequate.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- A normal test for independence via generalized mutual informationStatistics & Probability Letters, 2024
- Statistical Implications of Turing's Formula2016
- Entropic representation and estimation of diversity indicesJournal of Nonparametric Statistics, 2016
- A Note on Entropy EstimationNeural Computation, 2015
- Entropy Estimation in Turing's PerspectiveNeural Computation, 2012
- Re-parameterization of multinomial distributions and diversity indicesJournal of Statistical Planning and Inference, 2010
- Estimation of Entropy and Mutual InformationNeural Computation, 2003
- The Jacobian matrix and global univalence of mappingsMathematische Annalen, 1965
- On matrices with non-positive off-diagonal elements and positive principal minorsCzechoslovak Mathematical Journal, 1962
- X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random samplingJournal of Computers in Education, 1900