Evaluating replicability in microbiome data
Authors:
Open Access
- 30 December 2021
- journal article
- research article
- Published by Oxford University Press (OUP) in Biostatistics
- Vol. 23 (4) , 1099-1114
Abstract
High-throughput sequencing is widely used to study microbial communities. However, choice of laboratory protocol is known to affect the resulting microbiome data, which has an unquantified impact on many comparisons between communities of scientific interest. We propose a novel approach to evaluating replicability in high-dimensional data and apply it to assess the cross-laboratory replicability of signals in microbiome data using the Microbiome Quality Control Project data set. We learn distinctions between samples as measured by a single laboratory and evaluate whether the same distinctions hold in data produced by other laboratories. While most sequencing laboratories can consistently distinguish between samples (median correct classification 87% on genus-level proportion data), these distinctions frequently fail to hold in data from other laboratories (median correct classification 55% across laboratory on genus-level proportion data). As identical samples processed by different laboratories generate substantively different quantitative results, we conclude that 16S sequencing does not reliably resolve differences in human microbiome samples. However, because we observe greater replicability under certain data transformations, our results inform the analysis of microbiome data.Keywords
Funding Information
- The National Institute of General Medical Sciences
- NIGMS
- NIH (R35 GM133420)
- National Institute of Environmental Health Sciences (T32ES015459)
- Seattle Chapter of the ARCS Foundation
- ARCS Foundation
This publication has 27 references indexed in Scilit:
- DADA2: High-resolution sample inference from Illumina amplicon dataNature Methods, 2016
- Brain-gut-microbiota axis: challenges for translation in psychiatryAnnals of Epidemiology, 2016
- The microbiome quality control project: baseline study design and future directionsGenome Biology, 2015
- Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2Genome Biology, 2014
- voom: precision weights unlock linear model analysis tools for RNA-seq read countsGenome Biology, 2014
- Structure, function and diversity of the healthy human microbiomeNature, 2012
- The human microbiome: at the interface of health and diseaseNature Reviews Genetics, 2012
- False-Positive PsychologyPsychological Science, 2011
- edgeR: a Bioconductor package for differential expression analysis of digital gene expression dataBioinformatics, 2009
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005