Multimodal cell foundation models require synergistic integration beyond alignment
Open Access
- 9 November 2026
- journal article
- research article
- Published by Springer Nature in Nature Machine Intelligence
- p. 1-17
Abstract
Integrating measurements across modalities and scales into unified quantitative frameworks of cellular function is a central goal in computational biology. Although powerful unimodal foundation models exist, the scarcity of large-scale paired data limits joint multimodal training. This constraint favours compositional foundation models, which fuse frozen unimodal experts through a learned interface. However, it remains unclear when such fusion provides task-relevant information beyond the strongest unimodal representation rather than merely aggregating redundant signal. Here we introduce Synergistic Information Score, a metric grounded in partial information decomposition that quantifies information gain arising only from cross-modal interactions. Extending theory from self-supervised learning, we show that standard alignment-based objectives with frozen encoders collapse to detect linear redundancies, which constrains their ability to capture nonlinear synergistic states. This distinction is especially important for tasks that connect tissue morphology with gene expression. Benchmarking ten fusion methods on spatial transcriptomics datasets, we demonstrate that tasks dominated by linear redundancies are well served by unimodal baselines, whereas complex niche definitions benefit from synergy-aware integration. Finally, we perform a scaling analysis and show that fine-tuning a dominant unimodal expert is the most sample-efficient strategy for standard tasks. Together, these results suggest that progress in multimodal modelling of cellular state requires shifting from alignment-based objectives to synergy-driven integration that exploits complementary cross-modal signal.Keywords
This publication has 39 references indexed in Scilit:
- From modality-specific to compositional foundation models for cell biologyCell Systems, 2026
- A pre-trained large generative model for translating single-cell transcriptomes to proteomesNature Biomedical Engineering, 2025
- How to build the virtual cell with artificial intelligence: Priorities and opportunitiesCell, 2024
- Simple and effective embedding model for single-cell biology built from ChatGPTNature Biomedical Engineering, 2024
- High resolution mapping of the tumor microenvironment using integrated single-cell, spatial and in situ analysisNature Communications, 2023
- Quantifying Synergistic Mutual Information2014
- Elements of Information Theory2005
- Relations Between Two Sets of Variates1992
- A Rationale and Test for the Number of Factors in Factor AnalysisPsychometrika, 1965
- The Approximation of One Matrix by Another of Lower RankPsychometrika, 1936