Development and translation of human-AI interaction models into working prototypes for clinical decision-making
Authors:
- Muhammad HussainMHMuhammad Hussain
- Ioanna IacovidesIIIoanna Iacovides
- Tom LawtonTLTom Lawton
- Vishal SharmaVSVishal Sharma
- Zoe PorterZPZoe Porter
- Alice CunninghamACAlice Cunningham
- Ibrahim HabliIHIbrahim Habli
- Shireen HickeySHShireen Hickey
- Yan JiaYJYan Jia
- Phillip MorganPMPhillip Morgan
- Nee Ling WongNWNee Ling Wong
Open Access
- 1 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1607-1619
Abstract
In the standard interaction model of clinical decision support systems, the system makes a recommendation, and the clinician decides whether to act on it. However, this model can compromise the patient-centeredness of care and the level of clinician involvement. There is scope to develop alternative interaction models, but we need methods for exploring and comparing these to assess how they may impact clinical decision-making. Through collaborating with clinical, AI safety, and HCI experts, and patient representatives, we co-designed a number of alternative human-AI interaction models for clinical decision-making. We then translated these models into ‘Wizard of Oz’ prototypes, where we created clinical scenarios and designed user interfaces with different types of AI output. In this paper, we present alternative models of human-AI interaction and illustrate how we used a co-design approach to translate them into functional prototypes that can be tested with users to explore potential impacts on clinical decision-making.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/W011239/1)
- The MPS Foundation Grant Programme (2022-0000000206)
This publication has 64 references indexed in Scilit:
- Clinicians risk becoming “liability sinks” for artificial intelligenceFuture Healthcare Journal, 2024
- How the different explanation classes impact trust calibration: The case of clinical decision support systemsInternational Journal of Human-Computer Studies, 2022
- Decision-support systems for managing polypharmacy in the elderly: A scoping reviewJournal of Biomedical Informatics, 2022
- Human-centered XAI: Developing design patterns for explanations of clinical decision support systemsInternational Journal of Human-Computer Studies, 2021
- Levels of explainable artificial intelligence for human-aligned conversational explanationsArtificial Intelligence, 2021
- Association of Clinician Diagnostic Performance With Machine Learning–Based Decision Support SystemsJAMA Network Open, 2021
- How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selectionTranslational Psychiatry, 2021
- Machine behaviourNature, 2019
- Automated Identification of Diabetic Retinopathy Using Deep LearningOphthalmology, 2017
- The coming of age of artificial intelligence in medicineArtificial Intelligence in Medicine, 2009