General-purpose pre-trained large cellular models for single-cell transcriptomics
Open Access
- 25 September 2024
- journal article
- editorial
- Published by Oxford University Press (OUP) in National Science Review
- Vol. 11 (11) , nwae340
Abstract
Recent development of large language models (LLMs) in AI has inspired scientists to develop a few large-scale AI foundation models for single-cell transcriptomics or large cellular models (LCMs) pretrained on massive single-cell RNA-seq data. They illustrated superior performances on a wide spectrum of tasks although the models were only pretrained in a self-supervised manner, without any specific design for the downstream tasks. The success opened a promising new route toward using AI models to grasp the underlying biological knowledge from massive data to a scale that cannot be handled by human analysis. This review introduces the basic principles, major technical variations and typical applications of the current LCMs, and also shares our perspective on open questions and future directions of this exciting field.Keywords
Funding Information
- National Natural Science Foundation of China (62250005)
- National Key Research and Development Program of China (2021YFF1200900)
This publication has 18 references indexed in Scilit:
- Large-scale foundation model on single-cell transcriptomicsNature Methods, 2024
- scGPT: toward building a foundation model for single-cell multi-omics using generative AINature Methods, 2024
- Predicting transcriptional outcomes of novel multigene perturbations with GEARSNature Biotechnology, 2023
- Transfer learning enables predictions in network biologyNature, 2023
- Generative pretraining from large-scale transcriptomes for single-cell decipheringiScience, 2023
- Evolutionary-scale prediction of atomic-level protein structure with a language modelScience, 2023
- hECA: The cell-centric assembly of a cell atlasiScience, 2022
- Toward a unified information framework for cell atlas assemblyNational Science Review, 2021
- NCBI Taxonomy: a comprehensive update on curation, resources and toolsDatabase: The Journal of Biological Databases and Curation, 2020
- The Human Cell AtlaseLife, 2017