scSwinFormer: A Transformer-Based Cell-Type Annotation Method for scRNA-Seq Data Using Smooth Gene Embedding and Global Features
Authors:
- 5 August 2024
- journal article
- research article
- Published by American Chemical Society (ACS) in Journal of Chemical Information and Modeling
- Vol. 64 (16) , 6316-6323
Abstract
Single-cell omics techniques have made it possible to analyze individual cells in biological samples, providing us with a more detailed understanding of cellular heterogeneity and biological systems. Accurate identification of cell types is critical for single-cell RNA sequencing (scRNA-seq) analysis. However, scRNA-seq data are usually high dimensional and sparse, posing a great challenge to analyze scRNA-seq data. Existing cell-type annotation methods are either constrained in modeling scRNA-seq data or lack consideration of long-term dependencies of characterized genes. In this work, we developed a Transformer-based deep learning method, scSwinFormer, for the cell-type annotation of large-scale scRNA-seq data. Sequence modeling of scRNA-seq data is performed using the smooth gene embedding module, and then, the potential dependencies of genes are captured by the self-attention module. Subsequently, the global information inherent in scRNA-seq data is synthesized using the Cell Token, thereby facilitating accurate cell-type annotation. We evaluated the performance of our model against current state-of-the-art scRNA-seq cell-type annotation methods on multiple real data sets. ScSwinFormer outperforms the current state-of-the-art scRNA-seq cell-type annotation methods in both external and benchmark data set experiments.Keywords
This publication has 44 references indexed in Scilit:
- Comprehensive Integration of Single-Cell DataCell, 2019
- scmap: projection of single-cell RNA-seq data across data setsNature Methods, 2018
- Identifying cell populations with scRNASeqMolecular Aspects of Medicine, 2018
- Visualization and analysis of single-cell RNA-seq data by kernel-based similarity learningNature Methods, 2017
- Design and Analysis of Single-Cell Sequencing ExperimentsCell, 2015
- RNA sequencing: advances, challenges and opportunitiesNature Reviews Genetics, 2010
- RNA-Seq—quantitative measurement of expression through massively parallel RNA-sequencingMethods, 2009
- mRNA-Seq whole-transcriptome analysis of a single cellNature Methods, 2009
- RNA-Seq: a revolutionary tool for transcriptomicsNature Reviews Genetics, 2009
- Mapping and quantifying mammalian transcriptomes by RNA-SeqNature Methods, 2008