Kathryn Langenfeld
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Kathryn Langenfeld has a total of 83 co-authors. Here are the top co-authors by number of shared publications:
- Krista Rule Wigginton
University of Michigan
7 shared publications - Melissa Beth Duhaime
University of Michigan
6 shared publications - Bridget Hegarty
Department of Civil and Environmental Engineering, Case Western Reserve University, Cleveland, Ohio, USA
5 shared publications - Peter J. Arts
Department of Civil and Environmental Engineering, University of Michigan
4 shared publications Bridget Hegarty
Department of Civil and Environmental Engineering, Case Western Reserve University , Cleveland , OH 44106
3 shared publications- Craig L. Just
University of Iowa
3 shared publications
Latest Publications
- Open Access
- 5 October 2026
- Published by Taylor & Francis in Critical Insights in Environmental Science and Technology
- Vol. 1 (1)
Moving omics methods beyond the bench to tackle urgent challenges facing the water industry
1. Omic methods (e.g., metagenomics, metatranscriptomics, and metaproteomics) have emerged as a powerful tool for investigating biological systems. In human medicine, genomics has enabled precision...
- 5 October 2026
- Published by Taylor & Francis in Critical Insights in Environmental Science and Technology
- Vol. 1 (1)
Open AccessMoving omics methods beyond the bench to tackle urgent challenges facing the water industry
1. Omic methods (e.g., metagenomics, metatranscriptomics, and metaproteomics) have emerged as a powerful tool for investigating biological systems. In human medicine, genomics has enabled precision...
- Open Access
Quantitative insights into the role of phages and plasmids in the persistence of nontuberculous mycobacteria in chloraminated drinking water
Nontuberculous mycobacteria (NTM) are opportunistic pathogens that persist in chloraminated drinking water systems, yet the roles of phages and plasmids in their persistence remain largely unexplored. Using genome-resolved and quantitative metagenomics, we characterized NTM, phages, prophages, and plasmids in a chloraminated building plumbing system. Bacterial metagenome-assembled genomes (MAGs) and viral operational taxonomic units (vOTUs) were quantified at mean concentrations of 8.41 * 10^7 and 8.00 * 10^8 copies/L, respectively, including seven NTM MAGs at a mean total concentration of 4.01 * 10^5 copies/L. NTM concentrations were highest at the site with the lowest bacterial and viral diversity. Predicted NTM-infecting virus concentrations were inversely related to NTM concentrations across sites, suggesting complex phage-host dynamics that warrant direct experimental investigation. NTM, putative phages, prophages, and plasmids encoded functions related to disinfectant tolerance, stress response, metal resistance, and secretion. These findings identify phage interactions, prophages, and plasmids as overlooked genomic and ecological dimensions of NTM persistence in engineered water systems.
Open AccessQuantitative insights into the role of phages and plasmids in the persistence of nontuberculous mycobacteria in chloraminated drinking water
Nontuberculous mycobacteria (NTM) are opportunistic pathogens that persist in chloraminated drinking water systems, yet the roles of phages and plasmids in their persistence remain largely unexplored. Using genome-resolved and quantitative metagenomics, we characterized NTM, phages, prophages, and plasmids in a chloraminated building plumbing system. Bacterial metagenome-assembled genomes (MAGs) and viral operational taxonomic units (vOTUs) were quantified at mean concentrations of 8.41 * 10^7 and 8.00 * 10^8 copies/L, respectively, including seven NTM MAGs at a mean total concentration of 4.01 * 10^5 copies/L. NTM concentrations were highest at the site with the lowest bacterial and viral diversity. Predicted NTM-infecting virus concentrations were inversely related to NTM concentrations across sites, suggesting complex phage-host dynamics that warrant direct experimental investigation. NTM, putative phages, prophages, and plasmids encoded functions related to disinfectant tolerance, stress response, metal resistance, and secretion. These findings identify phage interactions, prophages, and plasmids as overlooked genomic and ecological dimensions of NTM persistence in engineered water systems.
- Open Access
- 26 May 2026
- Published by American Society for Microbiology in mSphere
- Vol. 11 (5) , e0011326
Novel machine learning-based approach to identify viral biomarkers of human respiratory emissions from oral and nasal metagenomes
Humans spend approximately 90% of their lives in built environments, making virus transmission indoors a key determinant of health. Environmental sampling of respiratory viral pathogens is often challenging because of frequent non-detect measurements. Non-detect measurements do not differentiate between samples containing low or no pathogens from samples that simply lack respiratory expulsions altogether. This ambiguity can be resolved by scanning samples for a biomarker of human respiratory emissions. To do so, reliable biomarkers for environmental monitoring need to be identified. Ideal biomarkers are prevalent across individuals, abundant, and unique to the human respiratory tract. Here, we present a new machine learning-based approach to query for suitable biomarker candidates from publicly available metagenomes and apply it to identify viral biomarkers of healthy oral and nasal microbiomes. Twelve viral biomarker candidates were selected from 1,232 curated viral operational taxonomic units. The viral biomarker candidates had as much as 63% prevalence across respiratory metagenomes, and prevalence was further increased to 77%–81% by combining two or three biomarkers. Real-time PCR confirmed that these viral biomarkers were prevalent and abundant in nasal swabs and saliva samples. Notably, top candidate biomarkers remained stable and detectable through multiple lab purification steps, increasing confidence in their viral origins and demonstrating their suitability for environmental monitoring. These findings demonstrate that existing metagenomes can be used to identify effective biomarker candidates for environmental sampling. IMPORTANCE: Developing non-pharmaceutical interventions to reduce virus transmission indoors relies on robust environmental monitoring methods. Monitoring viral pathogens is challenging because of frequent non-detect measurements that introduce uncertainty. For instance, a non-detect measurement could indicate either the absence of the pathogen or simply the lack of human respiratory activity and, thus, exposure. To aid in distinguishing these scenarios, this study identifies viruses from the human respiratory tract using publicly available sequencing data that can be incorporated into environmental monitoring as biomarkers of human respiratory activity. These viral biomarkers will improve indoor monitoring to help enact interventions to mitigate virus transmission. Furthermore, our approach to identify biomarkers from existing metagenomes can be adapted for future biomarker identification in any system.
- 26 May 2026
- Published by American Society for Microbiology in mSphere
- Vol. 11 (5) , e0011326
Open AccessNovel machine learning-based approach to identify viral biomarkers of human respiratory emissions from oral and nasal metagenomes
Humans spend approximately 90% of their lives in built environments, making virus transmission indoors a key determinant of health. Environmental sampling of respiratory viral pathogens is often challenging because of frequent non-detect measurements. Non-detect measurements do not differentiate between samples containing low or no pathogens from samples that simply lack respiratory expulsions altogether. This ambiguity can be resolved by scanning samples for a biomarker of human respiratory emissions. To do so, reliable biomarkers for environmental monitoring need to be identified. Ideal biomarkers are prevalent across individuals, abundant, and unique to the human respiratory tract. Here, we present a new machine learning-based approach to query for suitable biomarker candidates from publicly available metagenomes and apply it to identify viral biomarkers of healthy oral and nasal microbiomes. Twelve viral biomarker candidates were selected from 1,232 curated viral operational taxonomic units. The viral biomarker candidates had as much as 63% prevalence across respiratory metagenomes, and prevalence was further increased to 77%–81% by combining two or three biomarkers. Real-time PCR confirmed that these viral biomarkers were prevalent and abundant in nasal swabs and saliva samples. Notably, top candidate biomarkers remained stable and detectable through multiple lab purification steps, increasing confidence in their viral origins and demonstrating their suitability for environmental monitoring. These findings demonstrate that existing metagenomes can be used to identify effective biomarker candidates for environmental sampling. IMPORTANCE: Developing non-pharmaceutical interventions to reduce virus transmission indoors relies on robust environmental monitoring methods. Monitoring viral pathogens is challenging because of frequent non-detect measurements that introduce uncertainty. For instance, a non-detect measurement could indicate either the absence of the pathogen or simply the lack of human respiratory activity and, thus, exposure. To aid in distinguishing these scenarios, this study identifies viruses from the human respiratory tract using publicly available sequencing data that can be incorporated into environmental monitoring as biomarkers of human respiratory activity. These viral biomarkers will improve indoor monitoring to help enact interventions to mitigate virus transmission. Furthermore, our approach to identify biomarkers from existing metagenomes can be adapted for future biomarker identification in any system.
- Open Access
- 27 December 2025
- Published by Elsevier in Water Research
- Vol. 292, 125288
Biofiltration, seasonality, and distribution system factors influence nitrifier communities in a full-scale chloraminated drinking water system
- 27 December 2025
- Published by Elsevier in Water Research
- Vol. 292, 125288
Open AccessBiofiltration, seasonality, and distribution system factors influence nitrifier communities in a full-scale chloraminated drinking water system
- Open Access
- 18 November 2025
- Published by American Society for Microbiology in mSystems
- Vol. 10 (11) , e0082925
Floodplain nitrifiers harbor the genetic potential for utilizing a wide range of organic nitrogen compounds
Organic compounds such as urea and cyanate can serve as nitrogen (N) sources for nitrifying microorganisms, including ammonia-oxidizing archaea (AOA) and bacteria (AOB), complete ammonia-oxidizing (comammox) bacteria, and nitrite-oxidizing bacteria (NOB). Here we investigated metagenome-assembled genomes (MAGs) for all four nitrifier guilds generated from hydrologically variable floodplain sediments of the Wind River Basin (WRB; Riverton, WY, USA) for their genetic potential to utilize organic N compounds. A vast majority of WRB nitrifier MAGs harbored urease ( ure ) and at least one urea transporter ( utp , urt , dur3 ). AOA were the most abundant and phylogenetically diverse nitrifiers in WRB floodplain sediments. Several AOA MAGs encoded cyanase ( cynS ), nitrilase ( nit1 ), omega-amidase ( nit2 ), nitrile hydratase ( nthA ), and genes related to purine degradation, including biuret hydrolase ( biuH ), oxamic transcarbamylase ( allFGH ), and catabolic carbamate kinase ( allK ). AOA often encoded an uncharacterized amidohydrolase collocated with biuH , rather than allophanate hydrolase ( atzF ). A small number of AOA encoded atzF , functioning in an unknown pathway. AOB and comammox were of relatively low abundance and taxonomic diversity and were present only at certain depths in WRB; however, they encoded triuret/biuret degradation genes ( trtA , biuH , and atzH ), and in comammox, these genes were also collocated with allFGHK . The genetic potential of ammonia oxidizers in the WRB floodplain suggests that organic N may support nitrification in this system. The proposed pathways for utilizing purine degradation products other than urea potentially expand the known metabolic capabilities of AOA, AOB, and comammox bacteria and reveal the possibility for cryptic N cycling between microbial community members. IMPORTANCE: Floodplains are critical ecosystems where terrestrial and riverine systems meet. Floodplain sediments experience many, sometimes dramatic, changes in moisture and oxygen concentrations because of changes in water table height, flooding, and drought, leading to active microbial cycling of contaminants and nutrients. Nitrogen is one such nutrient that is not only essential for the building blocks of life but can also be used as an energy source by some microorganisms. Microorganisms that oxidize ammonia and nitrite are a crucial part of the nitrogen cycle and can lead to eventual nitrogen loss from a system. Investigating the genes present in microorganisms responsible for nitrification in a dynamic floodplain suggests that organic nitrogen—from decaying plants or potentially other sources, such as fertilizers, grazing livestock feces, or contaminants (e.g., pesticides, pharmaceuticals)—is an important nitrogen source to these microorganisms. This study identifies genes not previously described in nitrifying microorganisms, expanding their potential metabolic substrates.
- 18 November 2025
- Published by American Society for Microbiology in mSystems
- Vol. 10 (11) , e0082925
Open AccessFloodplain nitrifiers harbor the genetic potential for utilizing a wide range of organic nitrogen compounds
Organic compounds such as urea and cyanate can serve as nitrogen (N) sources for nitrifying microorganisms, including ammonia-oxidizing archaea (AOA) and bacteria (AOB), complete ammonia-oxidizing (comammox) bacteria, and nitrite-oxidizing bacteria (NOB). Here we investigated metagenome-assembled genomes (MAGs) for all four nitrifier guilds generated from hydrologically variable floodplain sediments of the Wind River Basin (WRB; Riverton, WY, USA) for their genetic potential to utilize organic N compounds. A vast majority of WRB nitrifier MAGs harbored urease ( ure ) and at least one urea transporter ( utp , urt , dur3 ). AOA were the most abundant and phylogenetically diverse nitrifiers in WRB floodplain sediments. Several AOA MAGs encoded cyanase ( cynS ), nitrilase ( nit1 ), omega-amidase ( nit2 ), nitrile hydratase ( nthA ), and genes related to purine degradation, including biuret hydrolase ( biuH ), oxamic transcarbamylase ( allFGH ), and catabolic carbamate kinase ( allK ). AOA often encoded an uncharacterized amidohydrolase collocated with biuH , rather than allophanate hydrolase ( atzF ). A small number of AOA encoded atzF , functioning in an unknown pathway. AOB and comammox were of relatively low abundance and taxonomic diversity and were present only at certain depths in WRB; however, they encoded triuret/biuret degradation genes ( trtA , biuH , and atzH ), and in comammox, these genes were also collocated with allFGHK . The genetic potential of ammonia oxidizers in the WRB floodplain suggests that organic N may support nitrification in this system. The proposed pathways for utilizing purine degradation products other than urea potentially expand the known metabolic capabilities of AOA, AOB, and comammox bacteria and reveal the possibility for cryptic N cycling between microbial community members. IMPORTANCE: Floodplains are critical ecosystems where terrestrial and riverine systems meet. Floodplain sediments experience many, sometimes dramatic, changes in moisture and oxygen concentrations because of changes in water table height, flooding, and drought, leading to active microbial cycling of contaminants and nutrients. Nitrogen is one such nutrient that is not only essential for the building blocks of life but can also be used as an energy source by some microorganisms. Microorganisms that oxidize ammonia and nitrite are a crucial part of the nitrogen cycle and can lead to eventual nitrogen loss from a system. Investigating the genes present in microorganisms responsible for nitrification in a dynamic floodplain suggests that organic nitrogen—from decaying plants or potentially other sources, such as fertilizers, grazing livestock feces, or contaminants (e.g., pesticides, pharmaceuticals)—is an important nitrogen source to these microorganisms. This study identifies genes not previously described in nitrifying microorganisms, expanding their potential metabolic substrates.
- Open Access
Novel Machine Learning-based Approach to Identify Viral Biomarkers of Human Respiratory Emissions from Oral and Nasal Metagenomes
Humans spend approximately 90% of their lives in built environments, making virus transmission indoors a key determinant of health. Environmental sampling of respiratory viral pathogens is often challenging because of frequent non-detect measurements. Non-detect measurements do not differentiate between samples containing low or no pathogens from samples that simply lack respiratory expulsions altogether. This ambiguity can be resolved by scanning samples for a biomarker of human respiratory emissions. To do so, reliable biomarkers for environmental monitoring need to be identified. Ideal biomarkers are prevalent across individuals, abundant, and unique to the human respiratory tract. Here, we present a new machine learning-based approach to query for suitable biomarker candidates from publicly available metagenomes and apply it to identify viral biomarkers of healthy oral and nasal microbiomes. Twelve viral biomarker candidates were selected from 1,232 curated viral operational taxonomic units. The viral biomarker candidates had as much as 63% prevalence across respiratory metagenomes and prevalence was further increased to 77-81% by combining two or three biomarkers. Quantitative PCR confirmed that these viral biomarkers were prevalent and abundant in nasal swabs and saliva samples. Notably, top candidate biomarkers remained stable and detectable through multiple lab purification steps, increasing confidence in their viral origins and demonstrating their suitability for environmental monitoring. These findings demonstrate that existing metagenomes can be used to identify effective biomarker candidates for environmental sampling. IMPORTANCE: Developing non-pharmaceutical interventions to reduce virus transmission indoors relies on robust environmental monitoring methods. Monitoring viral pathogens is challenging because of frequent non-detect measurements that introduce uncertainty. For instance, a non-detect measurement could indicate either the absence of the pathogen or simply the lack of human respiratory activity and thus exposure. To aid in distinguishing these scenarios, this study identifies viruses from the human respiratory tract using publicly available sequencing data that can be incorporated into environmental monitoring as biomarkers of human respiratory activity. These viral biomarkers will improve indoor monitoring to help enact interventions to mitigate virus transmission. Furthermore, our approach to identify biomarkers from existing metagenomes can be adapted for future biomarker identification in any system.
Open AccessNovel Machine Learning-based Approach to Identify Viral Biomarkers of Human Respiratory Emissions from Oral and Nasal Metagenomes
Humans spend approximately 90% of their lives in built environments, making virus transmission indoors a key determinant of health. Environmental sampling of respiratory viral pathogens is often challenging because of frequent non-detect measurements. Non-detect measurements do not differentiate between samples containing low or no pathogens from samples that simply lack respiratory expulsions altogether. This ambiguity can be resolved by scanning samples for a biomarker of human respiratory emissions. To do so, reliable biomarkers for environmental monitoring need to be identified. Ideal biomarkers are prevalent across individuals, abundant, and unique to the human respiratory tract. Here, we present a new machine learning-based approach to query for suitable biomarker candidates from publicly available metagenomes and apply it to identify viral biomarkers of healthy oral and nasal microbiomes. Twelve viral biomarker candidates were selected from 1,232 curated viral operational taxonomic units. The viral biomarker candidates had as much as 63% prevalence across respiratory metagenomes and prevalence was further increased to 77-81% by combining two or three biomarkers. Quantitative PCR confirmed that these viral biomarkers were prevalent and abundant in nasal swabs and saliva samples. Notably, top candidate biomarkers remained stable and detectable through multiple lab purification steps, increasing confidence in their viral origins and demonstrating their suitability for environmental monitoring. These findings demonstrate that existing metagenomes can be used to identify effective biomarker candidates for environmental sampling. IMPORTANCE: Developing non-pharmaceutical interventions to reduce virus transmission indoors relies on robust environmental monitoring methods. Monitoring viral pathogens is challenging because of frequent non-detect measurements that introduce uncertainty. For instance, a non-detect measurement could indicate either the absence of the pathogen or simply the lack of human respiratory activity and thus exposure. To aid in distinguishing these scenarios, this study identifies viruses from the human respiratory tract using publicly available sequencing data that can be incorporated into environmental monitoring as biomarkers of human respiratory activity. These viral biomarkers will improve indoor monitoring to help enact interventions to mitigate virus transmission. Furthermore, our approach to identify biomarkers from existing metagenomes can be adapted for future biomarker identification in any system.
- Open Access
- 27 February 2025
- Published by Oxford University Press (OUP) in Nucleic Acids Research
- Vol. 53 (5)
Development of a quantitative metagenomic approach to establish quantitative limits and its application to viruses
Quantitative metagenomic methods are maturing but continue to lack clearly-defined analytical limits. Here, we developed a computational tool, QuantMeta, to determine the absolute abundance of targets in metagenomes spiked with synthetic DNA standards. The tool establishes (i) entropy-based detection thresholds to confidently determine the presence of targets, and (ii) an approach to identify and correct read mapping or assembly errors and thus improve the quantification accuracy. Together this allows for an approach to confidently quantify absolute abundance of targets, be they microbial populations, genes, contigs, or metagenome-assembled genomes. We applied the approach to quantify single- and double-stranded DNA viruses in wastewater viral metagenomes, including pathogens and bacteriophages. Concentrations of total DNA viruses in wastewater influent and effluent were >108 copies/ml using QuantMeta. Human-associated DNA viruses were detected and quantifiable with QuantMeta thresholds, including polyomavirus, papillomavirus, and crAss-like phages, at concentrations similar to previous reports that utilized quantitative polymerase chain reaction (PCR)-based assays. Our results highlight the higher detection thresholds of quantitative metagenomics (approximately 500 copies/μl) as compared to PCR-based quantification (approximately 10 copies/μl) despite a sequencing depth of 200 million reads per sample. The QuantMeta approach, applicable to both viral and cellular metagenomes, advances quantitative metagenomics by improving the accuracy of measured target absolute abundances.
- 27 February 2025
- Published by Oxford University Press (OUP) in Nucleic Acids Research
- Vol. 53 (5)
Open AccessDevelopment of a quantitative metagenomic approach to establish quantitative limits and its application to viruses
Quantitative metagenomic methods are maturing but continue to lack clearly-defined analytical limits. Here, we developed a computational tool, QuantMeta, to determine the absolute abundance of targets in metagenomes spiked with synthetic DNA standards. The tool establishes (i) entropy-based detection thresholds to confidently determine the presence of targets, and (ii) an approach to identify and correct read mapping or assembly errors and thus improve the quantification accuracy. Together this allows for an approach to confidently quantify absolute abundance of targets, be they microbial populations, genes, contigs, or metagenome-assembled genomes. We applied the approach to quantify single- and double-stranded DNA viruses in wastewater viral metagenomes, including pathogens and bacteriophages. Concentrations of total DNA viruses in wastewater influent and effluent were >108 copies/ml using QuantMeta. Human-associated DNA viruses were detected and quantifiable with QuantMeta thresholds, including polyomavirus, papillomavirus, and crAss-like phages, at concentrations similar to previous reports that utilized quantitative polymerase chain reaction (PCR)-based assays. Our results highlight the higher detection thresholds of quantitative metagenomics (approximately 500 copies/μl) as compared to PCR-based quantification (approximately 10 copies/μl) despite a sequencing depth of 200 million reads per sample. The QuantMeta approach, applicable to both viral and cellular metagenomes, advances quantitative metagenomics by improving the accuracy of measured target absolute abundances.
- 22 December 2024
- Published by Wiley in Environmental Microbiology
- Vol. 26 (12) , e70009
Microbial Community of a Sandy Beach Subterranean Estuary is Spatially Heterogeneous and Impacted by Winter Waves
Subterranean estuaries (STEs) are critical ecosystems at the interface of meteoric groundwater and subsurface seawater that are threatened by sea level rise. To characterize the influence of tides and waves on the STE microbial community, we collected porewater samples from a high‐energy beach STE at Stinson Beach, California, USA, over the two‐week neap‐spring tidal transition during both a wet and dry season. The microbial community, analyzed by 16S rRNA gene (V4) amplicon sequencing, clustered according to consistent physicochemical features found within STEs. The porewater community harbored relatively abundant Proteobacteria, Verrucomicrobiota, and Bacteroidota, as well as members of the archaeal DPANN superphylum and bacterial Candidate Phyla Radiation (CPR). Tidal conditions were not associated with microbial community composition; however, a wave overtopping event significantly impacted the beach microbiome. As a baseline for environmental change, our results elucidate the unique dynamics of a STE microbiome with unprecedented temporal resolution, highlighting the transport of cellular material through beach porewater due to waves.
- 22 December 2024
- Published by Wiley in Environmental Microbiology
- Vol. 26 (12) , e70009
Microbial Community of a Sandy Beach Subterranean Estuary is Spatially Heterogeneous and Impacted by Winter Waves
Subterranean estuaries (STEs) are critical ecosystems at the interface of meteoric groundwater and subsurface seawater that are threatened by sea level rise. To characterize the influence of tides and waves on the STE microbial community, we collected porewater samples from a high‐energy beach STE at Stinson Beach, California, USA, over the two‐week neap‐spring tidal transition during both a wet and dry season. The microbial community, analyzed by 16S rRNA gene (V4) amplicon sequencing, clustered according to consistent physicochemical features found within STEs. The porewater community harbored relatively abundant Proteobacteria, Verrucomicrobiota, and Bacteroidota, as well as members of the archaeal DPANN superphylum and bacterial Candidate Phyla Radiation (CPR). Tidal conditions were not associated with microbial community composition; however, a wave overtopping event significantly impacted the beach microbiome. As a baseline for environmental change, our results elucidate the unique dynamics of a STE microbiome with unprecedented temporal resolution, highlighting the transport of cellular material through beach porewater due to waves.
- Open Access
- 19 March 2024
- Published by American Society for Microbiology in mSystems
- Vol. 9 (3) , e0110523
Benchmarking informatics approaches for virus discovery: caution is needed when combining in silico identification methods
Understanding the ecological impacts of viruses on natural and engineered ecosystems relies on the accurate identification of viral sequences from community sequencing data. To maximize viral recovery from metagenomes, researchers frequently combine viral identification tools. However, the effectiveness of this strategy is unknown. Here, we benchmarked combinations of six widely used informatics tools for viral identification and analysis (VirSorter, VirSorter2, VIBRANT, DeepVirFinder, CheckV, and Kaiju), called “rulesets.” Rulesets were tested against mock metagenomes composed of taxonomically diverse sequence types and diverse aquatic metagenomes to assess the effects of the degree of viral enrichment and habitat on tool performance. We found that six rulesets achieved equivalent accuracy [Matthews Correlation Coefficient (MCC) = 0.77, P adj ≥ 0.05]. Each contained VirSorter2, and five used our “tuning removal” rule designed to remove non-viral contamination. While DeepVirFinder, VIBRANT, and VirSorter were each found once in these high-accuracy rulesets, they were not found in combination with each other: combining tools does not lead to optimal performance. Our validation suggests that the MCC plateau at 0.77 is partly caused by inaccurate labeling within reference sequence databases. In aquatic metagenomes, our highest MCC ruleset identified more viral sequences in virus-enriched (44%–46%) than in cellular metagenomes (7%–19%). While improved algorithms may lead to more accurate viral identification tools, this should be done in tandem with careful curation of sequence databases. We recommend using the VirSorter2 ruleset and our empirically derived tuning removal rule. Our analysis provides insight into methods for in silico viral identification and will enable more robust viral identification from metagenomic data sets. IMPORTANCE: The identification of viruses from environmental metagenomes using informatics tools has offered critical insights in microbial ecology. However, it remains difficult for researchers to know which tools optimize viral recovery for their specific study. In an attempt to recover more viruses, studies are increasingly combining the outputs from multiple tools without validating this approach. After benchmarking combinations of six viral identification tools against mock metagenomes and environmental samples, we found that these tools should only be combined cautiously. Two to four tool combinations maximized viral recovery and minimized non-viral contamination compared with either the single-tool or the five- to six-tool ones. By providing a rigorous overview of the behavior of in silico viral identification strategies and a pipeline to replicate our process, our findings guide the use of existing viral identification tools and offer a blueprint for feature engineering of new tools that will lead to higher-confidence viral discovery in microbiome studies.
- 19 March 2024
- Published by American Society for Microbiology in mSystems
- Vol. 9 (3) , e0110523
Open AccessBenchmarking informatics approaches for virus discovery: caution is needed when combining in silico identification methods
Understanding the ecological impacts of viruses on natural and engineered ecosystems relies on the accurate identification of viral sequences from community sequencing data. To maximize viral recovery from metagenomes, researchers frequently combine viral identification tools. However, the effectiveness of this strategy is unknown. Here, we benchmarked combinations of six widely used informatics tools for viral identification and analysis (VirSorter, VirSorter2, VIBRANT, DeepVirFinder, CheckV, and Kaiju), called “rulesets.” Rulesets were tested against mock metagenomes composed of taxonomically diverse sequence types and diverse aquatic metagenomes to assess the effects of the degree of viral enrichment and habitat on tool performance. We found that six rulesets achieved equivalent accuracy [Matthews Correlation Coefficient (MCC) = 0.77, P adj ≥ 0.05]. Each contained VirSorter2, and five used our “tuning removal” rule designed to remove non-viral contamination. While DeepVirFinder, VIBRANT, and VirSorter were each found once in these high-accuracy rulesets, they were not found in combination with each other: combining tools does not lead to optimal performance. Our validation suggests that the MCC plateau at 0.77 is partly caused by inaccurate labeling within reference sequence databases. In aquatic metagenomes, our highest MCC ruleset identified more viral sequences in virus-enriched (44%–46%) than in cellular metagenomes (7%–19%). While improved algorithms may lead to more accurate viral identification tools, this should be done in tandem with careful curation of sequence databases. We recommend using the VirSorter2 ruleset and our empirically derived tuning removal rule. Our analysis provides insight into methods for in silico viral identification and will enable more robust viral identification from metagenomic data sets. IMPORTANCE: The identification of viruses from environmental metagenomes using informatics tools has offered critical insights in microbial ecology. However, it remains difficult for researchers to know which tools optimize viral recovery for their specific study. In an attempt to recover more viruses, studies are increasingly combining the outputs from multiple tools without validating this approach. After benchmarking combinations of six viral identification tools against mock metagenomes and environmental samples, we found that these tools should only be combined cautiously. Two to four tool combinations maximized viral recovery and minimized non-viral contamination compared with either the single-tool or the five- to six-tool ones. By providing a rigorous overview of the behavior of in silico viral identification strategies and a pipeline to replicate our process, our findings guide the use of existing viral identification tools and offer a blueprint for feature engineering of new tools that will lead to higher-confidence viral discovery in microbiome studies.
- Open Access
Benchmarking informatics approaches for virus discovery: Caution is needed when combining in silico identification methods
Background: The identification of viruses from environmental metagenomic samples using informatics tools has offered critical insights in microbiome studies. However, it remains difficult for researchers to know for their specific study which tool(s) and settings are best suited to maximize capture of viruses while minimizing false positives. Studies are increasingly combining multiple tool outputs attempting to recover more viruses, but no combined approach has been benchmarked for accuracy. Here, we benchmarked 63 viral identification ‘rulesets’ against mock metagenomes composed of publicly available viral, bacterial, archaeal, fungal, and protist sequences. These rulesets are based on combinations of four single-tool rules and two multi-tool tuning rules. We applied these rulesets to various aquatic metagenomes and filtering strategies to evaluate the impact of habitat and viral enrichment on individual and combined tool performance. We provide a packaged pipeline for researchers that want to replicate our process. Results: We found that combining rules increased viral recall, but at the expense of increased false positives. Six of the 63 combinations tested had equivalent accuracies to the highest one (MCC=0.77, p adj ≥ 0.05). All of the six high accuracy rulesets included VirSorter2, five included our “tuning removal” rule, and no high performing rulesets used more than four of our six rules. DeepVirFinder, VIBRANT, and VirSorter were each found once in these high accuracy rulesets, but never in combination with each other. Our validation suggests that the MCC plateau at 0.77 is caused by inaccurate labeling of the data that viral identification tools rely on for training and validation. In the aquatic metagenomes, our “highest MCC” ruleset identified a higher proportion of viral sequences in the virus-enriched samples (44-46%) than the non-enriched, cellular metagenomes (7-19%). Conclusion: While improved algorithms may lead to more accurate viral identification tools, this should be done in tandem with curating accurately labeled viral gene and sequence databases. For most applications, we recommend the use of the ruleset that uses VirSorter2 and our empirically derived tuning removal rule. By providing a rigorous overview of the behavior of in silico viral identification strategies, our findings guide the use of existing viral identification tools and offer a blueprint for feature engineering of new tools that will lead to higher-confidence viral discovery in microbiome studies.
Open AccessBenchmarking informatics approaches for virus discovery: Caution is needed when combining in silico identification methods
Background: The identification of viruses from environmental metagenomic samples using informatics tools has offered critical insights in microbiome studies. However, it remains difficult for researchers to know for their specific study which tool(s) and settings are best suited to maximize capture of viruses while minimizing false positives. Studies are increasingly combining multiple tool outputs attempting to recover more viruses, but no combined approach has been benchmarked for accuracy. Here, we benchmarked 63 viral identification ‘rulesets’ against mock metagenomes composed of publicly available viral, bacterial, archaeal, fungal, and protist sequences. These rulesets are based on combinations of four single-tool rules and two multi-tool tuning rules. We applied these rulesets to various aquatic metagenomes and filtering strategies to evaluate the impact of habitat and viral enrichment on individual and combined tool performance. We provide a packaged pipeline for researchers that want to replicate our process. Results: We found that combining rules increased viral recall, but at the expense of increased false positives. Six of the 63 combinations tested had equivalent accuracies to the highest one (MCC=0.77, p adj ≥ 0.05). All of the six high accuracy rulesets included VirSorter2, five included our “tuning removal” rule, and no high performing rulesets used more than four of our six rules. DeepVirFinder, VIBRANT, and VirSorter were each found once in these high accuracy rulesets, but never in combination with each other. Our validation suggests that the MCC plateau at 0.77 is caused by inaccurate labeling of the data that viral identification tools rely on for training and validation. In the aquatic metagenomes, our “highest MCC” ruleset identified a higher proportion of viral sequences in the virus-enriched samples (44-46%) than the non-enriched, cellular metagenomes (7-19%). Conclusion: While improved algorithms may lead to more accurate viral identification tools, this should be done in tandem with curating accurately labeled viral gene and sequence databases. For most applications, we recommend the use of the ruleset that uses VirSorter2 and our empirically derived tuning removal rule. By providing a rigorous overview of the behavior of in silico viral identification strategies, our findings guide the use of existing viral identification tools and offer a blueprint for feature engineering of new tools that will lead to higher-confidence viral discovery in microbiome studies.