Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: An inter-laboratory study
Authors:
- Ronan M. DoyleRDRonan M. Doyle
- Denise M. O’sullivanDODenise M. O’sullivan
- Sean D. AllerSASean D. Aller
- Sebastian BruchmannSBSebastian Bruchmann
- Taane G ClarkTaane G Clark
- Andreu Coello PelegrinAPAndreu Coello Pelegrin
- Martin CormicanMCMartin Cormican
- Ernest Diez BenaventeEBErnest Diez Benavente
- Matthew J. EllingtonMEMatthew J. Ellington
- Elaine McGrathEMElaine McGrath
- Yair MotroYMYair Motro
- Thi Phuong Thuy NguyenTNThi Phuong Thuy Nguyen
Preprint
Abstract
Background: Antimicrobial resistance (AMR) poses a threat to public health. Clinical microbiology laboratories typically rely on culturing bacteria for antimicrobial susceptibility testing (AST). As the implementation costs and technical barriers fall, whole-genome sequencing (WGS) has emerged as a ‘one-stop’ test for epidemiological and predictive AST results. Few published comparisons exist for the myriad analytical pipelines used for predicting AMR. To address this, we performed an inter-laboratory study providing sets of participating researchers with identical short-read WGS data sequenced from clinical isolates, allowing us to assess the reproducibility of the bioinformatic prediction of AMR between participants and identify problem cases and factors that lead to discordant results. Methods: We produced ten WGS datasets of varying quality from cultured carbapenem-resistant organisms obtained from clinical samples sequenced on either an Illumina NextSeq or HiSeq instrument. Nine participating teams (‘participants’) were provided these sequence data without any other contextual information. Each participant used their own pipeline to determine the species, the presence of resistance-associated genes, and to predict susceptibility or resistance to amikacin, gentamicin, ciprofloxacin and cefotaxime. Results: Individual participants predicted different numbers of AMR-associated genes and different gene variants from the same clinical samples. The quality of the sequence data, choice of bioinformatic pipeline and interpretation of the results all contributed to discordance between participants. Although much of the inaccurate gene variant annotation did not affect genotypic resistance predictions, we observed low specificity when compared to phenotypic AST results but this improved in samples with higher read depths. Had the results been used to predict AST and guide treatment a different antibiotic would have been recommended for each isolate by at least one participant. Conclusions: We found that participants produced discordant predictions from identical WGS data. These challenges, at the final analytical stage of using WGS to predict AMR, suggest the need for refinements when using this technology in clinical settings. Comprehensive public resistance sequence databases and standardisation in the comparisons between genotype and resistance phenotypes will be fundamental before AST prediction using WGS can be successfully implemented in standard clinical microbiology laboratories.Keywords
All Related Versions
- Published version: Microbial Genomics, 6 (2), e000335.
This publication has 35 references indexed in Scilit:
- The successful uptake and sustainability of rapid infectious disease and antimicrobial resistance point-of-care testing requires a complex ‘mix-and-match’ implementation packageEuropean Journal of Clinical Microbiology & Infectious Diseases, 2019
- How do advanced diagnostics support public health policy development?Eurosurveillance, 2019
- Developmental roadmap for antimicrobial susceptibility testing systemsNature Reviews Microbiology, 2018
- Bacterial genome sequencing in clinical microbiology: a pathogen-oriented reviewEuropean Journal of Clinical Microbiology & Infectious Diseases, 2017
- Same-day diagnostic and surveillance data for tuberculosis via whole genome sequencing of direct respiratory samplesbioRxiv, 2016
- Genotyping using whole-genome sequencing is a realistic alternative to surveillance based on phenotypic antimicrobial susceptibility testingJournal of Antimicrobial Chemotherapy, 2012
- Rapid whole-genome sequencing of bacterial pathogens in the clinical microbiology laboratory--pipe dream or reality?Journal of Antimicrobial Chemotherapy, 2012
- Evaluation of the Cepheid Xpert MTB/RIF Assay for Direct Detection of Mycobacterium tuberculosis Complex in Respiratory SpecimensJournal of Clinical Microbiology, 2011
- Detection of methicillin resistance in staphylococci by using a DNA probeAntimicrobial Agents and Chemotherapy, 1990
- On the Antibacterial Action of Cultures of a Penicillium, with Special Reference to Their Use in the Isolation of B. influenzaeClinical Infectious Diseases, 1980