Statistically Evaluating Connected Data: Topology-Aware Scores for Graph-Valued Predictions
Preprint
- 27 October 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Graph-valued outcomes are increasingly common in a variety of scientific observations, ranging from biomedical domains such connectomes, bioinformatics networks such as protein interactions to other disparate areas such as communications and social networks . Networks are estimated by a variety of statistical and machine learning techniques such as stochastic block models and graph-learning algorithms; however, evaluation of the parameters and predictions form such learning techniques often target an external class label or require a tractable graph likelihood. We propose a topology-aware generalization of Brier-type scoring rules for direct evaluation of any graph-valued predictions through a prespecified vector of permutation-invariant graph functionals. The score is likelihood-free, strictly proper for the conditional mean of the selected topology functional, and admits an exact excess-risk identity. With block-diagonal weights, it also decomposes additively into scientifically interpretable components, such as density, degree heterogeneity, clustering, connectivity, and spectral structure. We distinguish this predictive target from likelihood-ratio testing, label classification, adjusted Rand index, area under the receiver operating characteristic curve, and class-label logarithmic loss. A matched-density simulation comparing Erdos–Rényi and random-hub networks illustrates a setting in which density-based evaluation is intentionally uninformative while the topology differs. A second empirical evaluation uses the real dataset PROTEINS benchmark of protein graphs. The proposed score is intended for out-of-sample comparison of graph forecasts, particularly when likelihoods are unavailable, misspecified, or scientifically less interpretable than selected topological features.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- On misconceptions about the Brier score in binary prediction modelsGlobal Epidemiology, 2026
- Novel Scoring Rules for Evaluation of Multiple Time-Like Scales with Interval Censored Data in Impact Crash Engineering EnvironmentsJournal of the Indian Society for Probability and Statistics, 2025
- Theory and applications of proper scoring rulesMETRON, 2014
- Assessing the Performance of Prediction ModelsEpidemiology, 2010
- Complex brain networks: graph theoretical analysis of structural and functional systemsNature Reviews Neuroscience, 2009
- Protein function prediction via graph kernelsBioinformatics, 2005
- Network biology: understanding the cell's functional organizationNature Reviews Genetics, 2004
- Lethality and centrality in protein networksNature, 2001
- Comparing partitionsJournal of Classification, 1985
- IX. On the problem of the most efficient tests of statistical hypothesesPhilosophical Transactions of the Royal Society A, 1933