Randomized Clinical Trials of Machine Learning Interventions in Health Care
Top Cited Papers
Open Access
- 29 September 2022
- journal article
- review article
- Published by American Medical Association (AMA) in JAMA Network Open
- Vol. 5 (9) , e2233946
Abstract
Machine learning has the potential to improve the diagnosis and prognosis of disease to enhance clinical care. Given the increasing amount of digital data generated from routine medical care, available computational processing power, and research advances, such as deep learning, there has been substantial interest in applying machine learning techniques to improve patient care across medical disciplines.1,2 Models have been investigated for tasks such as improved cancer diagnosis, emergency department triage, and intensive care unit decision support.3-5 However, the recent failures to successfully implement machine learning systems in clinical settings have highlighted the limitations of this technology, generating disillusionment and distrust in their potential to impact medicine.6,7 These machine learning system failures are often attributable to a lack of generalizability, an inability to adapt a system trained with data from 1 context to perform well in a new one,8 or an inability to demonstrate a clinically meaningful benefit.7 Mitigation strategies have been proposed to ensure their applicability, such as the use of larger and more diverse data sets and direct collaborations with clinical experts in model development.9-11 We investigated a different and complementary area of study of machine learning model-testing procedures, randomized clinical trials (RCTs), which may affect their ultimate use in heterogeneous clinical settings.Keywords
This publication has 72 references indexed in Scilit:
- Increased detection of Barrett’s esophagus–associated neoplasia using wide-area trans-epithelial sampling: a multicenter, prospective, randomized trialGastrointestinal Endoscopy, 2018
- Calibration drift in regression and machine learning models for acute kidney injuryJournal of the American Medical Informatics Association, 2017
- PRESS Peer Review of Electronic Search Strategies: 2015 Guideline StatementJournal of Clinical Epidemiology, 2016
- External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challengesBMJ, 2016
- Machine Learning and Decision Support in Critical CareProceedings of the IEEE, 2016
- Automated Personalized Feedback for Physical Activity and Dietary Behavior Change With Mobile Phones: A Randomized Controlled Trial on AdultsJMIR mHealth and uHealth, 2015
- Incorporation of assessments of risk of bias of primary studies in systematic reviews of randomised trials: a cross-sectional studyBMJ Open, 2013
- Under-representation of women and ethnic minorities in vascular surgery randomized controlled trialsJournal of Vascular Surgery, 2009
- Predicting optimal CPAP by neural network reduces titration failure: a randomized studySleep and Breathing, 2009
- A new system for grading recommendations in evidence based guidelinesBMJ, 2001