Before the Clinic: Transparent and Operable Design Principles for Healthcare AI
Preprint
Abstract
The translation of artificial intelligence (AI) systems into clinical practice requires bridging fundamental gaps between explainable AI theory, clinician expectations, and governance requirements. While conceptual frameworks define what constitutes explainable AI (XAI) and qualitative studies identify clinician needs, little practical guidance exists for development teams to prepare AI systems prior to clinical evaluation. We propose two foundational design principles, Transparent Design and Operable Design, that operationalize pre-clinical technical requirements for healthcare AI. Transparent Design encompasses interpretability and understandability artifacts that enable case-level reasoning and system traceability. Operable Design encompasses calibration, uncertainty, and robustness to ensure reliable, predictable system behavior under real-world conditions. We ground these principles in established XAI frameworks, map them to documented clinician needs, and demonstrate their alignment with emerging governance requirements. This pre-clinical playbook provides actionable guidance for development teams, accelerates the path to clinical evaluation, and establishes a shared vocabulary bridging AI researchers, healthcare practitioners, and regulatory stakeholders. By explicitly scoping what can be built and verified before clinical deployment, we aim to reduce friction in clinical AI translation while remaining cautious about what constitutes validated, deployed explainability.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A manifesto on explainability for artificial intelligence in medicineArtificial Intelligence in Medicine, 2022
- Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AIBMJ, 2022
- Algorithmic Learning in a Random World2022
- Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extensionThe Lancet Digital Health, 2020
- Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extensionThe Lancet Digital Health, 2020
- From development to deployment: dataset shift, causality, and shift-stable models in health AIBiostatistics, 2019
- Dissecting racial bias in an algorithm used to manage the health of populationsScience, 2019
- High-performance medicine: the convergence of human and artificial intelligenceNature Medicine, 2019
- The need for uncertainty quantification in machine-assisted medical decision makingNature Machine Intelligence, 2019
- Has Management Studies Lost Its Way? Ideas for More Imaginative and Innovative ResearchJournal of Management Studies, 2012