STEAM: Spatial Transcriptomics Evaluation Algorithm and Metric for clustering performance
Open Access
- 31 August 2025
- journal article
- Published by Oxford University Press (OUP) in Briefings in Bioinformatics
- Vol. 26 (5)
Abstract
Spatial transcriptomic technologies allow researchers to explore the diversity and specificity of gene expression within an original tissue structure. Accurately identifying regions that are spatially coherent in both gene expression and physical tissue structures is an emerging topic; however, it is challenging because of the lack of ground truth labels which complicates the validation of clustering consistency and reproducibility. This highlights a need for a computational evaluation framework to rigorously and unbiasedly assess the clustering performance. To address this gap, we propose Spatial Transcriptomics Evaluation Algorithm and Metric (STEAM), a user-friendly computational pipeline to evaluate the consistency and reliability of clustering results by leveraging machine learning classification and prediction methods, with the goal of maintaining spatial proximity and gene expression patterns within clusters. In addition, it enables iterative correction of misclassified cells, providing actionable guidance for cluster refinement. We benchmarked STEAM on various public datasets, spanning multicell to single-cell resolution, normal and diseased tissues, as well as spatial transcriptomics and proteomics. The results highlighted its robustness and generalizability through comprehensive statistical evaluation metrics, such as Kappa score, F1 score, accuracy, adjusted rand index, normalized mutual information, and percentage of abnormal spots. Notably, STEAM supports multisample training, enabling cross-replicate clustering consistency assessments. Moreover, STEAM provides practical guidance by comparing clustering results across multiple approaches; here, we evaluated four representative methods encompassing both spatial-aware and spatial-ignorant strategies. In summary, STEAM is a promising tool for evaluating clustering robustness and benchmarking clustering performance for spatial omics data, offering valuable insights to drive reproducible discoveries in spatial biology.Keywords
All Related Versions
Funding Information
- National Library of Medicine of the National Institutes of Health (T15LM009451)
- Accelerating Medicines Partnership-Autoimmune and Immunologic Diseases Leadership Scholar Program (5UCAR081032–04)
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01AR085156)
This publication has 25 references indexed in Scilit:
- Characterizing spatial gene expression heterogeneity in spatially resolved single-cell transcriptomic data with nonuniform cellular densitiesGenome Research, 2021
- Robust decomposition of cell type mixtures in spatial transcriptomicsNature Biotechnology, 2021
- Transcriptome-scale spatial gene expression in the human dorsolateral prefrontal cortexNature Neuroscience, 2021
- Spatially resolved transcriptomics adds a new dimension to genomicsNature Methods, 2021
- Normalization and variance stabilization of single-cell RNA-seq data using regularized negative binomial regressionGenome Biology, 2019
- Fast, sensitive and accurate integration of single-cell data with HarmonyNature Methods, 2019
- From Louvain to Leiden: guaranteeing well-connected communitiesScientific Reports, 2019
- Dimensionality reduction for visualizing single-cell data using UMAPNature Biotechnology, 2018
- Interrater reliability: the kappa statisticBiochemia Medica, 2012
- Notes on continuous stochastic phenomena.1950