Jason G. Kralj
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jason G. Kralj has a total of 158 co-authors. Here are the top co-authors by number of shared publications:
- Stephanie L. Servetas
Complex Microbial Systems Group, Biosystems and Biomaterials Division, National Institute of Standards and Technology, 100 Bureau Dr., Gaithersburg, MD 20899, USA
10 shared publications Jennifer N. Dootz
Complex Microbial Systems Group, Biosystems and Biomaterials Division, National Institute of Standards and Technology, 100 Bureau Dr., Gaithersburg, MD 20899, USA
8 shared publications- Scott A. Jackson
Complex Microbial Systems Group, Biosystems and Biomaterials Division, National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA.
8 shared publications Stephanie L. Servetas
National Institute of Standards and Technology
6 shared publicationsSamuel P. Forry
National Institute of Standards and Technology
5 shared publications- Samuel P. Forry
Biosystems and Biomaterials Division, NIST
5 shared publications
Latest Publications
- Open Access
Reversible decrease in swimming motility accompanies emergent β-lactam antibiotic resistance in Escherichia coli
Antimicrobial resistance (AMR) threatens global health, food security, and development; however, the evolutionary and molecular pathways that drive AMR remain poorly understood, limiting our ability to advance diagnostics and rapidly detect newly emerging resistance. In this report, we employed laboratory evolution of an environmental Escherichia coli strain (NIST 0056) under β-lactam antibiotic pressure (ampicillin and cephalexin) to specifically investigate the relationship between resistance genotype and motility phenotype. Within 10 passages, populations evolved varying levels of β-lactam resistance (including high-level resistance > 32 µg/mL) and showed consistent, dose-dependent reductions in swimming motility. Whole-population genome sequencing revealed large deletions in marR , SNPs in efflux pump gene acrB and fumarate reductase gene frdD, and mutations with evidence of amplification in the chromosomal class C β-lactamase gene ampC, collectively linking these efflux-mediated, β-lactam resistance mechanisms to loss of motility. Notably, motility reductions were more pronounced in individual clones than in the mixed populations ( p < 0.005, Mann-Whitney; two-tailed test). Following removal of antibiotic pressure, motility was restored and AMR-associated mutations decreased in frequency, suggesting fitness costs associated with resistance. In aggregate, our results demonstrate that reduced swimming motility accompanies specific efflux-driven, β-lactam resistance mechanisms. Further work will investigate if the behavior is generalizable across flagellated Enterobacteriaceae. Because these rapid changes are amenable to high-throughput measurement, swimming motility may offer a tractable physiological metric for AMR detection in environmental surveillance.
Open AccessReversible decrease in swimming motility accompanies emergent β-lactam antibiotic resistance in Escherichia coli
Antimicrobial resistance (AMR) threatens global health, food security, and development; however, the evolutionary and molecular pathways that drive AMR remain poorly understood, limiting our ability to advance diagnostics and rapidly detect newly emerging resistance. In this report, we employed laboratory evolution of an environmental Escherichia coli strain (NIST 0056) under β-lactam antibiotic pressure (ampicillin and cephalexin) to specifically investigate the relationship between resistance genotype and motility phenotype. Within 10 passages, populations evolved varying levels of β-lactam resistance (including high-level resistance > 32 µg/mL) and showed consistent, dose-dependent reductions in swimming motility. Whole-population genome sequencing revealed large deletions in marR , SNPs in efflux pump gene acrB and fumarate reductase gene frdD, and mutations with evidence of amplification in the chromosomal class C β-lactamase gene ampC, collectively linking these efflux-mediated, β-lactam resistance mechanisms to loss of motility. Notably, motility reductions were more pronounced in individual clones than in the mixed populations ( p < 0.005, Mann-Whitney; two-tailed test). Following removal of antibiotic pressure, motility was restored and AMR-associated mutations decreased in frequency, suggesting fitness costs associated with resistance. In aggregate, our results demonstrate that reduced swimming motility accompanies specific efflux-driven, β-lactam resistance mechanisms. Further work will investigate if the behavior is generalizable across flagellated Enterobacteriaceae. Because these rapid changes are amenable to high-throughput measurement, swimming motility may offer a tractable physiological metric for AMR detection in environmental surveillance.
- Open Access
- 22 July 2026
- Published by Springer Nature in Analytical and Bioanalytical Chemistry
- p. 1-16
Supporting molecular detection of A(H5N1) through development and characterization of RNA reference materials
- 22 July 2026
- Published by Springer Nature in Analytical and Bioanalytical Chemistry
- p. 1-16
Open AccessSupporting molecular detection of A(H5N1) through development and characterization of RNA reference materials
- Top Cited PapersOpen Access
- 27 January 2026
- Published by American Society for Microbiology in Applied and Environmental Microbiology
- Vol. 92 (1) , e0112625
A mathematical framework to correct for compositionality in microbiome data sets
The increasing use of metagenomic sequencing (MGS) for microbiome analysis has significantly advanced our understanding of microbial communities and their roles in various biological processes, including human health, environmental cycling, and disease. However, the inherent compositionality of MGS data, where the relative abundance of each taxon depends on the abundance of all other taxa, complicates the measurement of individual taxa and the interpretation of microbiome data. Here, we describe an experimental design that incorporates exogenous internal standards in routine MGS analyses to correct for compositional distortions. A mathematical framework was developed for using the observed internal standard relative abundance to calculate “Scaled Abundances” for native taxa that were (i) independent of sample composition and (ii) directly proportional to actual biological abundances. Through analysis of mock community and human gut microbiome samples, we demonstrate that Scaled Abundances outperformed traditional relative abundance measurements in both precision and accuracy and enabled reliable, quantitative comparisons of individual microbiome taxa across varied sample compositions and across a wide range of taxon abundances. By providing a pathway to accurate taxon quantification, this approach holds significant potential for advancing microbiome research, particularly in clinical and environmental health applications where precise microbial profiling is critical. IMPORTANCE: Metagenomic sequencing (MGS) analysis has become central to modern characterizations of microbiome samples. However, the inherent compositionality of these analyses, where the relative abundance of each taxon depends on the abundance of all other taxa, often complicates interpretations of results. We present here an experimental design and corresponding mathematical framework that uses internal standards with routine MGS methods to correct for compositional distortions. We validate this approach for both amplicon and shotgun MGS analysis of mock communities and human gut microbiome (fecal) samples. By using internal standards to remove compositionality, we demonstrate significantly improved measurement accuracy and precision for quantification of taxon abundances. This approach is broadly applicable across a wide range of microbiome research applications.
- 27 January 2026
- Published by American Society for Microbiology in Applied and Environmental Microbiology
- Vol. 92 (1) , e0112625
Top Cited PapersOpen AccessA mathematical framework to correct for compositionality in microbiome data sets
The increasing use of metagenomic sequencing (MGS) for microbiome analysis has significantly advanced our understanding of microbial communities and their roles in various biological processes, including human health, environmental cycling, and disease. However, the inherent compositionality of MGS data, where the relative abundance of each taxon depends on the abundance of all other taxa, complicates the measurement of individual taxa and the interpretation of microbiome data. Here, we describe an experimental design that incorporates exogenous internal standards in routine MGS analyses to correct for compositional distortions. A mathematical framework was developed for using the observed internal standard relative abundance to calculate “Scaled Abundances” for native taxa that were (i) independent of sample composition and (ii) directly proportional to actual biological abundances. Through analysis of mock community and human gut microbiome samples, we demonstrate that Scaled Abundances outperformed traditional relative abundance measurements in both precision and accuracy and enabled reliable, quantitative comparisons of individual microbiome taxa across varied sample compositions and across a wide range of taxon abundances. By providing a pathway to accurate taxon quantification, this approach holds significant potential for advancing microbiome research, particularly in clinical and environmental health applications where precise microbial profiling is critical. IMPORTANCE: Metagenomic sequencing (MGS) analysis has become central to modern characterizations of microbiome samples. However, the inherent compositionality of these analyses, where the relative abundance of each taxon depends on the abundance of all other taxa, often complicates interpretations of results. We present here an experimental design and corresponding mathematical framework that uses internal standards with routine MGS methods to correct for compositional distortions. We validate this approach for both amplicon and shotgun MGS analysis of mock communities and human gut microbiome (fecal) samples. By using internal standards to remove compositionality, we demonstrate significantly improved measurement accuracy and precision for quantification of taxon abundances. This approach is broadly applicable across a wide range of microbiome research applications.
- Open Access
- 18 November 2025
- Published by American Society for Microbiology in mSystems
- Vol. 10 (11) , e0046625
DNA reference reagents isolate biases in microbiome profiling: a global multi-lab study
When profiling the human gut microbiome, technical biases introduced by analytical approaches impede translational research, reducing data reliability and study comparability. Here, through a global study involving 23 labs, we analyzed a wide range of sequencing and bioinformatic approaches for the taxonomic profiling of two well-defined DNA reference reagents (RRs) comprised of 20 common gut bacteria. Through both shotgun and 16S rRNA gene amplicon sequencing, we aimed to isolate sources of bias and understand their impact on microbiome profiling accuracy. Importantly, minimum quality criteria (MQC) were established and are used to evaluate profiling performance. We found that the variability of shotgun sequencing data sets was greater than that of 16S rRNA gene amplicon sequencing and isolated sources of bias in wet and dry lab steps, such as sequencing depth, primer and database choices, rarefaction, and 16S copy number adjustment. This study presents well-defined RRs and MQC to combat technical bias, paving the way for reliable and comparable microbiome research. IMPORTANCE: This benchmark paper highlights the true level of variability in microbiome data across the world and across sectors, underscoring the critical need for the use of WHO International DNA Gut Reference Reagents (RRs) to elevate the quality of data in microbiome research. This global study is the first of its kind, revealing the reality of the bias in the field, comprehensively testing methodologies used by leading laboratories across the world, but also providing avenues for workflow optimization, to accelerate innovation and translational research and move the field forward.
- 18 November 2025
- Published by American Society for Microbiology in mSystems
- Vol. 10 (11) , e0046625
Open AccessDNA reference reagents isolate biases in microbiome profiling: a global multi-lab study
When profiling the human gut microbiome, technical biases introduced by analytical approaches impede translational research, reducing data reliability and study comparability. Here, through a global study involving 23 labs, we analyzed a wide range of sequencing and bioinformatic approaches for the taxonomic profiling of two well-defined DNA reference reagents (RRs) comprised of 20 common gut bacteria. Through both shotgun and 16S rRNA gene amplicon sequencing, we aimed to isolate sources of bias and understand their impact on microbiome profiling accuracy. Importantly, minimum quality criteria (MQC) were established and are used to evaluate profiling performance. We found that the variability of shotgun sequencing data sets was greater than that of 16S rRNA gene amplicon sequencing and isolated sources of bias in wet and dry lab steps, such as sequencing depth, primer and database choices, rarefaction, and 16S copy number adjustment. This study presents well-defined RRs and MQC to combat technical bias, paving the way for reliable and comparable microbiome research. IMPORTANCE: This benchmark paper highlights the true level of variability in microbiome data across the world and across sectors, underscoring the critical need for the use of WHO International DNA Gut Reference Reagents (RRs) to elevate the quality of data in microbiome research. This global study is the first of its kind, revealing the reality of the bias in the field, comprehensively testing methodologies used by leading laboratories across the world, but also providing avenues for workflow optimization, to accelerate innovation and translational research and move the field forward.
- 26 September 2025
- Published by National Institute of Standards and Technology (NIST)
NIST 2025 rapid microbial testing methods workshop report
In 2020, the National Institute of Standards and Technology (NIST)-led Rapid Microbial TestingMethods (RMTM) Consortium was established to develop standards and measurement-basedsolutions to facilitate the adoption of RMTMs in advanced therapy products. To update thecommunity on the Consortium's progress and work on its deliverables, NIST hosted its 5thannual workshop on RMTMs. This report summarizes the key findings from the workshop,which was held as a single-day virtual event featuring external speakers. The workshop broughttogether a diverse group of stakeholders, including advanced therapy producers, developers ofRMTM assays and instruments, and producers of cell reference materials.
- 26 September 2025
- Published by National Institute of Standards and Technology (NIST)
NIST 2025 rapid microbial testing methods workshop report
In 2020, the National Institute of Standards and Technology (NIST)-led Rapid Microbial TestingMethods (RMTM) Consortium was established to develop standards and measurement-basedsolutions to facilitate the adoption of RMTMs in advanced therapy products. To update thecommunity on the Consortium's progress and work on its deliverables, NIST hosted its 5thannual workshop on RMTMs. This report summarizes the key findings from the workshop,which was held as a single-day virtual event featuring external speakers. The workshop broughttogether a diverse group of stakeholders, including advanced therapy producers, developers ofRMTM assays and instruments, and producers of cell reference materials.
- 26 September 2025
- Published by National Institute of Standards and Technology (NIST)
Report from the 2023 NIST-hosted workshop on collaborative efforts to enable adoption of rapid microbial testing methods for advanced therapy products
On April 25, 2023, the National Institute of Standards and Technology (NIST) hosted a one-day hybrid workshop focused on bringing together organizations and working groups with the common goal of enabling validation and implementation of rapid microbial testing methods (RMTMs). The purpose of this workshop was to identify opportunities to leverage and coordinate ongoing and future efforts on RMTMs to accelerate their adoption for advanced therapy products. Based on workshop feedback, future areas of focus for the RMTM community to consider addressing include the need for data sharing – either via existing or new (e.g., interlaboratory study) datasets; increased awareness of existing regulatory and compendial initiatives, best practices, reference materials, and resources; and tools and measurement assurance strategies to advance the use of molecular-based RMTMs (such as next generation sequencing (NGS) and polymerase chain reaction (PCR). Increased collaborative efforts in these and other areas will promote the use of RMTMs and support improved safety for advanced therapy products.
- 26 September 2025
- Published by National Institute of Standards and Technology (NIST)
Report from the 2023 NIST-hosted workshop on collaborative efforts to enable adoption of rapid microbial testing methods for advanced therapy products
On April 25, 2023, the National Institute of Standards and Technology (NIST) hosted a one-day hybrid workshop focused on bringing together organizations and working groups with the common goal of enabling validation and implementation of rapid microbial testing methods (RMTMs). The purpose of this workshop was to identify opportunities to leverage and coordinate ongoing and future efforts on RMTMs to accelerate their adoption for advanced therapy products. Based on workshop feedback, future areas of focus for the RMTM community to consider addressing include the need for data sharing – either via existing or new (e.g., interlaboratory study) datasets; increased awareness of existing regulatory and compendial initiatives, best practices, reference materials, and resources; and tools and measurement assurance strategies to advance the use of molecular-based RMTMs (such as next generation sequencing (NGS) and polymerase chain reaction (PCR). Increased collaborative efforts in these and other areas will promote the use of RMTMs and support improved safety for advanced therapy products.
- 25 September 2025
- Published by National Institute of Standards and Technology (NIST)
NIST 2024 Rapid Microbial Testing Methods workshop report
The NIST-led Rapid Microbial Testing Methods (RMTM) Consortium launched in 2020 to develop standards and measurement-based solutions to advance the use of RMTMs in advanced therapy products. In April 2024, NIST hosted the 4th annual workshop on RMTMs to update the community on RMTM Consortium efforts and to advance Consortium deliverables. This report provides a summary of workshop activities and findings. The workshop consisted of several working sessions, 1 h to 2 h in length, focused on specific Working Group activities and deliverables. Day 1 was open to the public, and Day 2 was for Consortium members only. Parties that participated in the workshop included advanced therapy producers, RMTM assay/instrument developers, and cell reference material producers. Progress was made on multiple Consortium activities via the session discussions, and feedback was provided to help scope potential future Consortium activities. Overall, the workshop helped ensure relevance and impact of RMTM Consortium activities.
- 25 September 2025
- Published by National Institute of Standards and Technology (NIST)
NIST 2024 Rapid Microbial Testing Methods workshop report
The NIST-led Rapid Microbial Testing Methods (RMTM) Consortium launched in 2020 to develop standards and measurement-based solutions to advance the use of RMTMs in advanced therapy products. In April 2024, NIST hosted the 4th annual workshop on RMTMs to update the community on RMTM Consortium efforts and to advance Consortium deliverables. This report provides a summary of workshop activities and findings. The workshop consisted of several working sessions, 1 h to 2 h in length, focused on specific Working Group activities and deliverables. Day 1 was open to the public, and Day 2 was for Consortium members only. Parties that participated in the workshop included advanced therapy producers, RMTM assay/instrument developers, and cell reference material producers. Progress was made on multiple Consortium activities via the session discussions, and feedback was provided to help scope potential future Consortium activities. Overall, the workshop helped ensure relevance and impact of RMTM Consortium activities.
- Open Access
A mathematical framework to correct for compositionality in microbiome datasets
The increasing use of metagenomic sequencing (MGS) for microbiome analysis has significantly advanced our understanding of microbial communities and their roles in various biological processes, including human health, environmental cycling, and disease. However, the inherent compositionality of MGS data, where the relative abundance of each taxa depends on the abundance of all other taxa, complicates the measurement of individual taxa and the interpretation of microbiome data. Here we describe an experimental design that incorporates exogenous internal standards in routine MGS analyses to correct for compositional distortions. A mathematical framework was developed for using the observed internal standard relative abundance to calculate “Scaled Abundances” for native taxa that were (i) independent of sample composition and (ii) directly proportional to actual biological abundances. Through rigorous analysis of mock community and human gut microbiome samples, we demonstrate that Scaled Abundances outperformed traditional relative abundance measurements in both precision and accuracy and enabled reliable, quantitative comparisons of individual microbiome taxa across varied sample compositions and across a wide range of taxa abundances. By providing a pathway to accurate taxa quantification, this approach holds significant potential for advancing microbiome research, particularly in clinical and environmental health applications where precise microbial profiling is critical. Importance: Metagenomic sequencing (MGS) analysis has become central to modern characterizations of microbiome samples. However, the inherent compositionality of these analyses often complicate interpretations of results. We present here an experimental design and corresponding mathematical framework that uses internal standards with routine MGS methods to correct for compositional distortions. We validate this approach for both amplicon and shotgun MGS analysis of mock communities and human gut microbiome (fecal) samples. By using internal standards to remove compositionality, we demonstrate significantly improved measurement accuracy and precision for quantification of taxa abundances. This approach is broadly applicable across a wide range of microbiome research applications.
Open AccessA mathematical framework to correct for compositionality in microbiome datasets
The increasing use of metagenomic sequencing (MGS) for microbiome analysis has significantly advanced our understanding of microbial communities and their roles in various biological processes, including human health, environmental cycling, and disease. However, the inherent compositionality of MGS data, where the relative abundance of each taxa depends on the abundance of all other taxa, complicates the measurement of individual taxa and the interpretation of microbiome data. Here we describe an experimental design that incorporates exogenous internal standards in routine MGS analyses to correct for compositional distortions. A mathematical framework was developed for using the observed internal standard relative abundance to calculate “Scaled Abundances” for native taxa that were (i) independent of sample composition and (ii) directly proportional to actual biological abundances. Through rigorous analysis of mock community and human gut microbiome samples, we demonstrate that Scaled Abundances outperformed traditional relative abundance measurements in both precision and accuracy and enabled reliable, quantitative comparisons of individual microbiome taxa across varied sample compositions and across a wide range of taxa abundances. By providing a pathway to accurate taxa quantification, this approach holds significant potential for advancing microbiome research, particularly in clinical and environmental health applications where precise microbial profiling is critical. Importance: Metagenomic sequencing (MGS) analysis has become central to modern characterizations of microbiome samples. However, the inherent compositionality of these analyses often complicate interpretations of results. We present here an experimental design and corresponding mathematical framework that uses internal standards with routine MGS methods to correct for compositional distortions. We validate this approach for both amplicon and shotgun MGS analysis of mock communities and human gut microbiome (fecal) samples. By using internal standards to remove compositionality, we demonstrate significantly improved measurement accuracy and precision for quantification of taxa abundances. This approach is broadly applicable across a wide range of microbiome research applications.
- 1 April 2025
- Published by American Society for Microbiology in Microbiology Spectrum
- Vol. 13 (4) , e0280624
Analytical assessment of metagenomic workflows for pathogen detection with NIST RM 8376 and two sample matrices
We assessed the analytical performance of metagenomic workflows using NIST Reference Material (RM) 8376 DNA from bacterial pathogens spiked into two simulated clinical samples: cerebrospinal fluid (CSF) and stool. Sequencing and taxonomic classification were used to generate signals for each sample and taxa of interest and to estimate the limit of detection (LOD), the linearity of response, and linear dynamic range. We found that the LODs for taxa spiked into CSF ranged from approximately 100 to 300 copy/mL, with a linearity of 0.96 to 0.99. For stool, the LODs ranged from 10 to 221 kcopy/mL, with a linearity of 0.99 to 1.01. Furthermore, discriminating different E. coli strains proved to be workflow-dependent as only one classifier:database combination of the three tested showed the ability to differentiate the two pathogenic and commensal strains. Surprisingly, when we compared the linear response of the same taxa in the two different sample types, we found those functions to be the same, despite large differences in LODs. This suggests that the “agnostic diagnostic” theory for metagenomics (i.e., any organism can be identified because DNA is the measurand) may apply to different target organisms and different sample types. Because we are using RMs, we were able to generate quantitative analytical performance metrics for each workflow and sample set, enabling relatively rapid workflow screening before employing clinical samples. This makes these RMs a useful tool that will generate data needed to support the translation of metagenomics into regulated use. IMPORTANCE: Assessing the analytical performance of metagenomic workflows, especially when developing clinical diagnostics, is foundational for ensuring that the measurements underlying a diagnosis are supported by rigorous characterization. To facilitate the translation of metagenomics into clinical practice, workflows must be tested using control samples designed to probe the analytical limitations (e.g., limit of detection). Spike-ins allow developers to generate fit-for-purpose control samples for initial workflow assessments and inform decisions about further development. However, clinical sample types include a wide range of compositions and concentrations, each presenting different detection challenges. In this work, we demonstrate how spike-ins elucidate workflow performance in two highly dissimilar sample types (stool and CSF), and we provide evidence that detection of individual organisms is unaffected by background sample composition, making detection sample-agnostic within a workflow. These demonstrations and performance insights will facilitate the translation of the technology to the clinic.
- 1 April 2025
- Published by American Society for Microbiology in Microbiology Spectrum
- Vol. 13 (4) , e0280624
Analytical assessment of metagenomic workflows for pathogen detection with NIST RM 8376 and two sample matrices
We assessed the analytical performance of metagenomic workflows using NIST Reference Material (RM) 8376 DNA from bacterial pathogens spiked into two simulated clinical samples: cerebrospinal fluid (CSF) and stool. Sequencing and taxonomic classification were used to generate signals for each sample and taxa of interest and to estimate the limit of detection (LOD), the linearity of response, and linear dynamic range. We found that the LODs for taxa spiked into CSF ranged from approximately 100 to 300 copy/mL, with a linearity of 0.96 to 0.99. For stool, the LODs ranged from 10 to 221 kcopy/mL, with a linearity of 0.99 to 1.01. Furthermore, discriminating different E. coli strains proved to be workflow-dependent as only one classifier:database combination of the three tested showed the ability to differentiate the two pathogenic and commensal strains. Surprisingly, when we compared the linear response of the same taxa in the two different sample types, we found those functions to be the same, despite large differences in LODs. This suggests that the “agnostic diagnostic” theory for metagenomics (i.e., any organism can be identified because DNA is the measurand) may apply to different target organisms and different sample types. Because we are using RMs, we were able to generate quantitative analytical performance metrics for each workflow and sample set, enabling relatively rapid workflow screening before employing clinical samples. This makes these RMs a useful tool that will generate data needed to support the translation of metagenomics into regulated use. IMPORTANCE: Assessing the analytical performance of metagenomic workflows, especially when developing clinical diagnostics, is foundational for ensuring that the measurements underlying a diagnosis are supported by rigorous characterization. To facilitate the translation of metagenomics into clinical practice, workflows must be tested using control samples designed to probe the analytical limitations (e.g., limit of detection). Spike-ins allow developers to generate fit-for-purpose control samples for initial workflow assessments and inform decisions about further development. However, clinical sample types include a wide range of compositions and concentrations, each presenting different detection challenges. In this work, we demonstrate how spike-ins elucidate workflow performance in two highly dissimilar sample types (stool and CSF), and we provide evidence that detection of individual organisms is unaffected by background sample composition, making detection sample-agnostic within a workflow. These demonstrations and performance insights will facilitate the translation of the technology to the clinic.
- 4 February 2025
- Published by American Society for Microbiology in Microbiology Spectrum
- Vol. 13 (2) , e0069624
A sensitivity analysis of methodological variables associated with microbiome measurements
The experimental methods employed during metagenomic sequencing analyses of microbiome samples significantly impact the resulting data and typically vary substantially between laboratories. In this study, a full factorial experimental design was used to compare the effects of a select set of methodological choices (sample, operator, lot, extraction kit, variable region, and reference database) on the analysis of biologically diverse stool samples. For each parameter investigated, a main effect was calculated that allowed direct comparison both between methodological choices (bias effects) and between samples (real biological differences). Overall, methodological bias was found to be similar in magnitude to real biological differences while also exhibiting significant variations between individual taxa, even between closely related genera. The quantified method biases were then used to computationally improve the comparability of data sets collected under substantially different protocols. This investigation demonstrates a framework for quantitatively assessing methodological choices that could be routinely performed by individual laboratories to better understand their metagenomic sequencing workflows and to improve the scope of the datasets they produce. IMPORTANCE: Method-specific bias is a well-recognized challenge in metagenomic sequencing characterization of microbiome samples, but rigorous bias quantification is challenging. This report details a full factorial exploration of 48 experimental protocols by systematically varying microbiome sample, iterations of material production, laboratory personnel, DNA extraction kit, marker gene selection, and reference databases. Quantification of the biases associated with each parameter revealed similar magnitudes of variation arising from real biological differences and from varied analysis procedures. Furthermore, these measurement biases varied substantially with taxa, even between closely related genera. However, computational correction of method bias using a reference material was demonstrated that significantly harmonized metagenomic sequencing results collected using different analysis protocols.
- 4 February 2025
- Published by American Society for Microbiology in Microbiology Spectrum
- Vol. 13 (2) , e0069624
A sensitivity analysis of methodological variables associated with microbiome measurements
The experimental methods employed during metagenomic sequencing analyses of microbiome samples significantly impact the resulting data and typically vary substantially between laboratories. In this study, a full factorial experimental design was used to compare the effects of a select set of methodological choices (sample, operator, lot, extraction kit, variable region, and reference database) on the analysis of biologically diverse stool samples. For each parameter investigated, a main effect was calculated that allowed direct comparison both between methodological choices (bias effects) and between samples (real biological differences). Overall, methodological bias was found to be similar in magnitude to real biological differences while also exhibiting significant variations between individual taxa, even between closely related genera. The quantified method biases were then used to computationally improve the comparability of data sets collected under substantially different protocols. This investigation demonstrates a framework for quantitatively assessing methodological choices that could be routinely performed by individual laboratories to better understand their metagenomic sequencing workflows and to improve the scope of the datasets they produce. IMPORTANCE: Method-specific bias is a well-recognized challenge in metagenomic sequencing characterization of microbiome samples, but rigorous bias quantification is challenging. This report details a full factorial exploration of 48 experimental protocols by systematically varying microbiome sample, iterations of material production, laboratory personnel, DNA extraction kit, marker gene selection, and reference databases. Quantification of the biases associated with each parameter revealed similar magnitudes of variation arising from real biological differences and from varied analysis procedures. Furthermore, these measurement biases varied substantially with taxa, even between closely related genera. However, computational correction of method bias using a reference material was demonstrated that significantly harmonized metagenomic sequencing results collected using different analysis protocols.