Evaluating artificial intelligence in medicine: phases of clinical research
Authors:
Top Cited Papers
Open Access
- 8 September 2020
- journal article
- research article
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 3 (3) , 326-331
Abstract
Increased scrutiny of artificial intelligence (AI) applications in healthcare highlights the need for real-world evaluations for effectiveness and unintended consequences. The complexity of healthcare, compounded by the user- and context-dependent nature of AI applications, calls for a multifaceted approach beyond traditional in silico evaluation of AI. We propose an interdisciplinary, phased research framework for evaluation of AI implementations in healthcare. We draw analogies to and highlight differences from the clinical trial phases for drugs and medical devices, and we present study design and methodological guidance for each stage.Keywords
This publication has 31 references indexed in Scilit:
- An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational StudiesMultivariate Behavioral Research, 2011
- A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systemsNeural Computing and Applications, 2010
- Matching Methods for Causal Inference: A Review and a Look ForwardStatistical Science, 2010
- The coming of age of artificial intelligence in medicineArtificial Intelligence in Medicine, 2009
- AI TURNS FIFTY: REVISITING ITS ORIGINSApplied Artificial Intelligence, 2007
- Estimating causal effects from epidemiological dataJournal of Epidemiology and Community Health, 2006
- Cognitive and usability engineering methods for the evaluation of clinical information systemsJournal of Biomedical Informatics, 2004
- Evaluation of health information systems—problems and challengesInternational Journal of Medical Informatics, 2003
- Designing Medical Informatics Research and Library--Resource Projects to Increase What Is LearnedJournal of the American Medical Informatics Association, 1994
- I.—COMPUTING MACHINERY AND INTELLIGENCEMind, 1950