StereoMM: A Graph Fusion Model for Integrating Spatial Transcriptomic Data and Pathological Images
Authors:
Preprint
Abstract
Spatially resolved omics technologies generating multimodal and high-throughput data lead to the urgent need for advanced analysis to allow the biological discoveries by comprehensively utilizing information from multi-omics data. The H&E image and spatial transcriptomic data indicate abundant features which are different and complementary to each other. AI algorithms can perform nonlinear analysis on these aligned or unaligned complex datasets to decode tumoral heterogeneity for detecting functional domain. However,the interpretability of AI-generated outcomes for human experts is a problem hindering application of multi-modal analysis in clinic. We presented a machine learning based toolchain called StereoMM, which is a graph fusion model that can integrate gene expression, histological images, and spatial location. StereoMM firstly performs information interaction on transcriptomic and imaging features through the attention module, guaranteeing explanations for its decision-making processes. The interactive features are input into the graph autoencoder together with the graph of spatial position, so that multimodal features are fused in a self-supervised manner. Here, StereoMM was subjected to mouse brain tissue, demonstrating its capability to discern fine tissue architecture, while highlighting its advantage in computational speed. Utilizing data from Stereo-seq of human lung adenosquamous carcinoma and 10X Visium of human breast cancer, we showed its superior performance in spatial domain recognition over competing software and its ability to reveal tumor heterogeneity. The fusion approach for imaging and gene expression data within StereoMM aids in the more accurate identification of domains, unveils critical molecular features, and elucidates the connections between different domains, thereby laying the groundwork for downstream analysis.Keywords
All Related Versions
- Published version: Briefings in Bioinformatics, 26 (3).
This publication has 34 references indexed in Scilit:
- Mutual regulation of TGFβ-induced oncogenic EMT, cell cycle progression and the DDRSeminars in Cancer Biology, 2023
- Artificial intelligence for predictive biomarker discovery in immuno-oncology: a systematic reviewAnnals of Oncology, 2023
- Computational solutions for spatial transcriptomicsComputational and Structural Biotechnology Journal, 2022
- Spatial omics: Navigating to the golden era of cancer researchClinical and Translational Medicine, 2022
- Cell-type modeling in spatial transcriptomics data elucidates spatially variable colocalization and communication between cell-types in mouse brainCell Systems, 2021
- Downregulation of nc886 contributes to prostate cancer cell invasion and TGFβ1-induced EMTGenes & Diseases, 2021
- Targeting claudin‐overexpressing thyroid and lung cancer by modified Clostridium perfringens enterotoxinMolecular Oncology, 2019
- Evaluation of cytokeratin 19 as a prognostic tumoral and metastatic marker with focus on improved detection methodsJournal of Cellular Physiology, 2019
- Microenvironmental regulation of tumor progression and metastasisNature Medicine, 2013
- CSF-1R inhibition alters macrophage polarization and blocks glioma progressionNature Medicine, 2013