Geometry of Statistical Manifolds
Author:
Open Access
Abstract
A statistical manifold M can be defined as a Riemannian manifold each of whose points is a probability distribution on the same support. In fact, statistical manifolds possess a richer geometric structure beyond the Fisher information metric defined on the tangent bundle . Recognizing that points in M are distributions and not just generic points in a manifold, can be extended to a Hilbert bundle . This extension proves fundamental when we generalize the classical notion of a point estimate—a single point in M—to a function on M that characterizes the relationship between observed data and each distribution in M. The log likelihood and score functions are important examples of generalized estimators. In terms of a parameterization , is a distribution on while its generalization as an estimate is a function over that indicates inconsistency between the model and data. As an estimator, is a distribution of functions. Geometric properties of these functions describe statistical properties of . In particular, the expected slopes of are used to define , the -information of . The Fisher information I is an upper bound for the -information: for all g, . We demonstrate the utility of this geometric perspective using the two-sample problem.
Keywords
This publication has 12 references indexed in Scilit:
- Generalized estimation and informationInformation Geometry, 2025
- Generalized estimators, slope, efficiency, and fisher information boundsInformation Geometry, 2022
- Affine statistical bundle modeled on a Gaussian Orlicz–Sobolev spaceInformation Geometry, 2022
- Geometrical Foundations of Asymptotic Inference1997
- Estimation in the Presence of Infinitely many Nuisance Parameters--Geometry of Estimating FunctionsThe Annals of Statistics, 1988
- Stage T3 squamous cell carcinoma of the glottic larynx treated with surgery and/or radiation therapyInternational Journal of Radiation Oncology - Biology - Physics (IJROBP), 1984
- The Geometry of Exponential FamiliesThe Annals of Statistics, 1978
- Some aspects of the theory of estimating equationsJournal of Statistical Planning and Inference, 1978
- An Optimum Property of Regular Maximum Likelihood EstimationThe Annals of Mathematical Statistics, 1960
- Statistical Methods and Scientific InductionJournal of the Royal Statistical Society Series B: Statistical Methodology, 1955