A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study
Authors:
- Shahzad MumtazSMShahzad Mumtaz
- Megan McMinnMMMegan McMinn
- Christian ColeCCChristian Cole
- Chuang GaoCGChuang Gao
- Christopher HallCHChristopher Hall
- Magalie Guignard-DuffMGMagalie Guignard-Duff
- Huayi HuangHHHuayi Huang
- David A McAllisterDMDavid A McAllister
- Daniel R MoralesDMDaniel R Morales
- Emily JeffersonEJEmily Jefferson
- Bruce GuthrieBGBruce Guthrie
Open Access
- 16 January 2025
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 27, e52385
Abstract
Background: Clinical guideline development preferentially relies on evidence from randomized controlled trials (RCTs). RCTs are gold-standard methods to evaluate the efficacy of treatments with the highest internal validity but limited external validity, in the sense that their findings may not always be applicable to or generalizable to clinical populations or population characteristics. The external validity of RCTs for the clinical population is constrained by the lack of tailored epidemiological data analysis designed for this purpose due to data governance, consistency of disease or condition definitions, and reduplicated effort in analysis code. Objective: This study aims to develop a digital tool that characterizes the overall population and differences between clinical trial eligible and ineligible populations from the clinical populations of a disease or condition regarding demography (eg, age, gender, ethnicity), comorbidity, coprescription, hospitalization, and mortality. Currently, the process is complex, onerous, and time-consuming, whereas a real-time tool may be used to rapidly inform a guideline developer’s judgment about the applicability of evidence. Methods: The National Institute for Health and Care Excellence—particularly the gout guideline development group—and the Scottish Intercollegiate Guidelines Network guideline developers were consulted to gather their requirements and evidential data needs when developing guidelines. An R Shiny (R Foundation for Statistical Computing) tool was designed and developed using electronic primary health care data linked with hospitalization and mortality data built upon an optimized data architecture. Disclosure control mechanisms were built into the tool to ensure data confidentiality. The tool was deployed within a Trusted Research Environment, allowing only trusted preapproved researchers to conduct analysis. Results: The tool supports 128 chronic health conditions as index conditions and 161 conditions as comorbidities (33 in addition to the 128 index conditions). It enables 2 types of analyses via the graphic interface: overall population and stratified by user-defined eligibility criteria. The analyses produce an overview of statistical tables (eg, age, gender) of the index condition population and, within the overview groupings, produce details on, for example, electronic frailty index, comorbidities, and coprescriptions. The disclosure control mechanism is integral to the tool, limiting tabular counts to meet local governance needs. An exemplary result for gout as an index condition is presented to demonstrate the tool’s functionality. Guideline developers from the National Institute for Health and Care Excellence and the Scottish Intercollegiate Guidelines Network provided positive feedback on the tool. Conclusions: The tool is a proof-of-concept, and the user feedback has demonstrated that this is a step toward computer-interpretable guideline development. Using the digital tool can potentially improve evidence-driven guideline development through the availability of real-world data in real time.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Multimorbidity—a defining challenge for health systemsThe Lancet Public Health, 2019
- A chronological map of 308 physical and mental health conditions from 4 million individuals in the English National Health ServiceThe Lancet Digital Health, 2019
- Gout Severity, Socioeconomic Status, and Work Absence: A Cross‐Sectional Study in Primary CareArthritis Care & Research, 2018
- Development and validation of an electronic frailty index using routine primary care electronic health record dataAge and Ageing, 2016
- Systematic reviews do not comment on applicability for primary careJournal of Clinical Epidemiology, 2015
- Computer-interpretable clinical guidelines: A methodological reviewJournal of Biomedical Informatics, 2013
- Guidelines for people not for diseases: the challenges of applying UK clinical guidelines to people with multimorbidityAge and Ageing, 2012
- GRADE guidelines: 8. Rating the quality of evidence—indirectnessJournal of Clinical Epidemiology, 2011
- Febuxostat Compared with Allopurinol in Patients with Hyperuricemia and GoutNew England Journal of Medicine, 2005
- Clinical Practice Guidelines and Quality of Care for Older Patients With Multiple Comorbid DiseasesJAMA, 2005