Gibbs normalizability and maximum-entropy programs with bilinear moment constraints on orthants
Open Access
- 1 January 2026
- journal article
- Published by American Institute of Mathematical Sciences (AIMS) in AIMS Mathematics
- Vol. 11 (9) , 31758-31813
Abstract
Gibbs weights with attractive bilinear interactions need not define probability laws on unbounded orthants. This paper gives a maximum-entropy and partition-function classification of that failure. For densities on $ [0, \infty)^2 $ with prescribed marginal means and product moment $ \mathbb{E}[XY] $, the entropy program is well posed exactly when $ \mathbb{E}[XY]\le \mathbb{E}[X] \mathbb{E}[Y] $. In the attractive case $ \mathbb{E}[XY] > \mathbb{E}[X] \mathbb{E}[Y] $, the entropy supremum equals the means-only product-exponential value but is not attained: The attractive constraint is entropically invisible while destroying normalizability. We then identify the repairs. Self-moment damping of orders $ p, q > 1 $ normalizes every attractive bilinear exponent when $ 1/p+1/q < 1 $ and never normalizes it when $ 1/p+1/q > 1 $. In the critical case $ 1/p+1/q = 1 $, normalizability is decided by an explicit inequality between the damping coefficients, which at $ p = q = 2 $ is the Gaussian condition $ \gamma^2 < 4\alpha\alpha' $; when that inequality holds with equality, the linear multipliers decide, and we classify this remaining boundary completely. Hard-wall confinement also repairs the model: Truncation to $ [0, K]^2 $ restores well-posedness and has sharp entropy deficit $ \Delta(\mu_1^{-1}+\mu_2^{-1})/K+o(K^{-1}) $. In dimension $ n $, quadratic Gibbs normalizability is governed by copositivity of the negated coupling matrix together with the sign of the linear field on the zero cone, in every regime except a degenerate boundary of transverse codimension at least two, which we leave unresolved; the associated decision problem is co-NP-hard, where co-NP is the class of decision problems whose complements belong to nondeterministic polynomial time (NP). The results give checkable criteria for when bilinear maximum-entropy models on orthants are genuinely solvable.
Keywords
This publication has 40 references indexed in Scilit:
- Fast rates of exponential cost functionStatistical Papers, 2025
- Information and Exponential Families2014
- On the computational complexity of membership problems for the completely positive cone and its dualComputational Optimization and Applications, 2013
- Elements of Information Theory2005
- Conditional Specification of Statistical Models2004
- A Weak Convergence Approach to the Theory of Large Deviations1997
- Some NP-complete problems in quadratic and nonlinear programmingMathematical Programming, 1987
- Asymptotic evaluation of certain markov process expectations for large time, ICommunications on Pure and Applied Mathematics, 1975
- Superstable interactions in classical statistical mechanicsCommunications in Mathematical Physics, 1970
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948