Benchmarking RNA-seq with the Quartet and MAQC reference materials to establish best practices for accurate alternative splicing analysis
Open Access
- 8 August 2026
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 17 (1)
Abstract
Previous limited characterization of short-read RNA-seq (srRNA-seq) accuracy in alternative splicing (AS) analysis due to methodological diversity and lack of reference standards, has left unclear how to achieve optimal performance—an issue increasingly critical with the rise of long-read sequencing. To address this, we conduct a large-scale reference-based benchmarking study across 42 laboratories and 207 analysis pipelines leveraging the Quartet and MAQC reference materials. Here, we show that high data quality and depth improved the accuracy of splice junction detection, as well as isoform- and event-level quantification and differential analysis. Best practices for experimental and bioinformatic design are identified, with optimal pipelines achieving Pearson and Matthews correlation coefficients of 0.79 and 0.68 for isoform-level quantification and differential analysis, and 0.41 and 0.41 for event-level analyses, respectively. This corresponds to improvements of 0.21–0.45 and 0.51–0.67 at the isoform level, and 0.09–0.27 and 0.16–0.34 at the event level relative to the poorest-performing pipelines across laboratories. Beyond technical workflows, low expression or coverage and high compositional complexity represent general constraints on accuracy. Collectively, this study provides practical guidance for maximizing AS profiling accuracy with existing methodologies, contributing to effective srRNA-seq application in RNA splicing research.Keywords
All Related Versions
Funding Information
- Beijing Natural Science Foundation
- Noncommunicable Chronic Diseases-National Science and Technology Major Project
- National Key Research and Development Program of China
This publication has 82 references indexed in Scilit:
- The role of alternative splicing in cancer: From oncogenesis to drug resistanceDrug Resistance Updates, 2020
- Efficient and Accurate Quantitative Profiling of Alternative Splicing Patterns of Any Complexity on a LaptopMolecular Cell, 2018
- Comprehensive Analysis of Alternative Splicing Across Tumors from 8,705 PatientsCancer Cell, 2018
- Near-optimal probabilistic RNA-seq quantificationNature Biotechnology, 2016
- StringTie enables improved reconstruction of a transcriptome from RNA-seq readsNature Biotechnology, 2015
- Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing studyNature Biotechnology, 2014
- A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control ConsortiumNature Biotechnology, 2014
- Sailfish enables alignment-free isoform quantification from RNA-seq reads using lightweight algorithmsNature Biotechnology, 2014
- Differential analysis of gene regulation at transcript resolution with RNA-seqNature Biotechnology, 2012
- Principal Variance Components Analysis: Estimating Batch Effects in Microarray Gene Expression Data2009