A framework for the oversight and local deployment of safe and high-quality prediction models
Top Cited Papers
- 31 May 2022
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 29 (9) , 1631-1636
Abstract
Artificial intelligence/machine learning models are being rapidly developed and used in clinical practice. However, many models are deployed without a clear understanding of clinical or operational impact and frequently lack monitoring plans that can detect potential safety signals. There is a lack of consensus in establishing governance to deploy, pilot, and monitor algorithms within operational healthcare delivery workflows. Here, we describe a governance framework that combines current regulatory best practices and lifecycle management of predictive models being used for clinical care. Since January 2021, we have successfully added models to our governance portfolio and are currently managing 52 models.Keywords
This publication has 13 references indexed in Scilit:
- Prediction Models — Development, Evaluation, and Clinical ApplicationNew England Journal of Medicine, 2020
- Overcoming barriers to the adoption and implementation of predictive modeling and machine learning in clinical care: what can we learn from US academic medical centers?JAMIA Open, 2020
- Presenting machine learning model information to clinical end users with model facts labelsnpj Digital Medicine, 2020
- Bridging the implementation gap of machine learning in healthcareBMJ Innovations, 2019
- Key challenges for delivering clinical impact with artificial intelligenceBMC Medicine, 2019
- Dissecting racial bias in an algorithm used to manage the health of populationsScience, 2019
- Minimal Impact of Implemented Early Warning Score and Best Practice Alert for Patient Deterioration*Critical Care Medicine, 2019
- A Pragmatic Guide to Establishing Clinical Decision Support Governance and Addressing Decision Support Fatigue: a Case Study.2018
- Opportunities and challenges in developing deep learning models using electronic health records data: a systematic reviewJournal of the American Medical Informatics Association, 2018
- Machine Learning and Prediction in Medicine — Beyond the Peak of Inflated ExpectationsNew England Journal of Medicine, 2017