Automated evaluation of single-cell reference atlas mappings enables the identification of disease-associated cell states
Preprint
Abstract
The rise of single-cell atlases has opened up the use of reference atlases as a comprehensive healthy control for the study of disease. A key step for using atlases is the mapping of “query” disease or perturbed datasets onto a healthy reference atlas, which allows for comparison of the query to healthy controls and thereby the identification of perturbation-specific transcriptional cell states. However, the mapping success, i.e. the extent to which these mappings correctly reflect biological similarities and differences between query and reference, varies with e.g. experimental confounders in the data (dissociation protocol, single-cell assay) or the mapping method used, and cannot be predicted in advance. Moreover, an unsuccessful mapping can result in falsely reporting technical artifacts as disease or perturbation-specific cellular changes and in overlooking true altered states. Here, we present MapQC, a method that quantifies query-to-reference mapping success by leveraging the information present in the reference embedding. Specifically, MapQC tests the presence of remaining batch effect in the embedding after mapping by comparing inter-sample distances in the healthy reference itself to distance of query control samples to the reference. Similarly, it tests whether disease or perturbation-specific variation has been retained during mapping by testing whether query perturbed samples are more distant to the reference than reference samples are from each other. We apply MapQC to lung and endometrial query datasets, including data of idiopathic pulmonary fibrosis and Asherman Syndrome, mapped to large-scale healthy references. We show that MapQC correctly distinguishes successful mappings from unsuccessful ones where data visualization techniques such as UMAP can be deceiving, and that mapQC outperforms integration metrics often re-purposed for mapping qualitycontrol. Moreover, only mappings that MapQC identified as successful result in the correct identification of cell state changes specific to disease. Taken together, MapQC provides a critical quality-control metric for a more reliable, robust, and accurate use of reference atlases to study disease.Keywords
Funding Information
- German Federal Ministry of Education and Research (81Z0600106)
- European Union (101054957)
- Deutsche Forschungsgemeinschaft (5010338)
This publication has 58 references indexed in Scilit:
- The future of rapid and automated single-cell data analysis using reference mappingCell, 2024
- A comprehensive mouse kidney atlas enables rare cell population characterization and robust marker discoveryiScience, 2023
- Distinct tissue niches direct lung immunopathology via CCL18 and CCL21 in severe COVID-19Nature Communications, 2023
- Mapping information-rich genotype-phenotype landscapes with genome-scale Perturb-seqCell, 2022
- Efficient and precise single-cell reference atlas mapping with SymphonyNature Communications, 2021
- Integrated analysis of multimodal single-cell dataCell, 2021
- Collagen-producing lung cell atlas identifies multiple subsets with distinct localization and relevance to fibrosisNature Communications, 2020
- Optimal-Transport Analysis of Single-Cell Gene Expression Identifies Developmental Trajectories in ReprogrammingCell, 2019
- Energy distanceWIREs Computational Statistics, 2015
- Energy statistics: A class of statistics based on distancesJournal of Statistical Planning and Inference, 2013