Simple and effective embedding model for single-cell biology built from ChatGPT
Top Cited Papers
- 6 December 2024
- journal article
- research article
- Published by Springer Nature in Nature Biomedical Engineering
- Vol. 9 (4) , 483-493
Abstract
Large-scale gene-expression data are being leveraged to pretrain models that implicitly learn gene and cellular functions. However, such models require extensive data curation and training. Here we explore a much simpler alternative: leveraging ChatGPT embeddings of genes based on the literature. We used GPT-3.5 to generate gene embeddings from text descriptions of individual genes and to then generate single-cell embeddings by averaging the gene embeddings weighted by each gene’s expression level. We also created a sentence embedding for each cell by using only the gene names ordered by their expression level. On many downstream tasks used to evaluate pretrained single-cell embedding models—particularly, tasks of gene-property and cell-type classifications—our model, which we named GenePT, achieved comparable or better performance than models pretrained from gene-expression profiles of millions of cells. GenePT shows that large-language-model embeddings of the literature provide a simple and effective path to encoding single-cell biological knowledge.Keywords
This publication has 44 references indexed in Scilit:
- Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning ExaminationsJAMA Internal Medicine, 2023
- Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media ForumJAMA Internal Medicine, 2023
- Role of Chat GPT in Public HealthAnnals of Biomedical Engineering, 2023
- Transformer for one stop interpretable cell type annotationNature Communications, 2023
- A pan-cancer single-cell transcriptional atlas of tumor infiltrating myeloid cellsCell, 2021
- Automated methods for cell type annotation on scRNA-seq dataComputational and Structural Biotechnology Journal, 2021
- The Gene Expression Omnibus Database2016
- Understanding multicellular function and disease with human tissue-specific networksNature Genetics, 2015
- A Proteome-Scale Map of the Human Interactome NetworkCell, 2014
- Five Years of GWAS DiscoveryThe American Journal of Human Genetics, 2012