X-Cell: Scaling Causal Perturbation Prediction Across Diverse Cellular Contexts via Diffusion Language Models
Top Cited Papers
Preprint
Abstract
Causal models of cellular systems hold the promise to empower broad biological discovery, including the systematic identification of novel targets for drug discovery. Predicting how genetic and pathway perturbations reshape gene expression across diverse cellular contexts is a prerequisite for building generalizable cellular foundation models. However, current methods typically fail to extrapolate beyond their training distributions because they rely predominantly on observational expression atlases rather than interventional perturbation data. We present X-Atlas/Pisces, the largest genome-wide CRISPRi Perturb-seq compendium to date, comprising 25.6 million perturbed single-cell transcriptomes across 16 biologically diverse contexts, including widely used cell lines, induced pluripotent stem cells (iPSCs), resting and CD3/CD28 activated Jurkat T lymphoma cells, and multi-lineage differentiating iPSCs. Leveraging this resource, we develop X-Cell, a diffusion language model that predicts perturbation responses by iteratively refining control-to-perturbed state transitions through cross-attention to multi-modal biological priors derived from natural language, protein language models, interaction networks, genetic dependency maps, and morphological profiles. X-Cell outperforms existing state-of-the-art models by up to five-fold on key metrics such as Pearson Δ (correlation between predicted and observed perturbation-induced log-fold changes), and demonstrates zero-shot prediction of T cell inactivating perturbations in stimulated Jurkat cells. We scale X-Cell to 4.9 billion parameters (X-Cell-Ultra), the largest causal perturbation model to date. We demonstrate for the first time that perturbation prediction follows power-law scaling with an exponent matching large language models. X-Cell-Ultra demonstrates zero-shot generalization to novel biological contexts, including unseen iPSC-derived melanocyte progenitors and primary human CD4 + T cells from multiple donors, and outperforms all baselines after self-supervised test-time adaptation. These results demonstrate that coordinated scaling of causal perturbation data and model capacity yields foundation models capable of generalizable perturbation prediction across cellular contexts, with potential applications for improving computational target identification, validation, and context-specific therapeutic prioritization.Keywords
This publication has 67 references indexed in Scilit:
- Virtual Cell Challenge: Toward a Turing test for the virtual cellCell, 2025
- How to build the virtual cell with artificial intelligence: Priorities and opportunitiesCell, 2024
- Toward a foundation model of causal cell and tissue biology with a Perturbation Cell and Tissue AtlasCell, 2024
- Glycan Epitope and Integrin Expression Dynamics Characterize Neural Crest Epithelial-to-Mesenchymal Transition (EMT) in Human Pluripotent Stem Cell DifferentiationStem Cell Reviews and Reports, 2022
- Mapping information-rich genotype-phenotype landscapes with genome-scale Perturb-seqCell, 2022
- Optimal-Transport Analysis of Single-Cell Gene Expression Identifies Developmental Trajectories in ReprogrammingCell, 2019
- Architecture of Human Mitochondrial Respiratory Megacomplex I2III2IV2Cell, 2017
- Defining a Cancer Dependency MapCell, 2017
- A Unique Microglia Type Associated with Restricting Development of Alzheimer’s DiseaseCell, 2017
- Perturb-Seq: Dissecting Molecular Circuits with Scalable Single-Cell RNA Profiling of Pooled Genetic ScreensCell, 2016