Designing Interaction with AI for Human Learning: Towards Human-Machine Teaming in Radiology Training
Open Access
- 2 December 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 639-647
Abstract
We explore the design of systems that enable humans and machines to operate as teams, exercising their different and complementary abilities to work and learn together. Machine Learning (ML) is now widely used in diverse applications such as medical image reading and autonomous vehicles, but typically, ML systems are not designed with human learning in mind, sometimes eroding or supplanting human skills, creating a whole that is less than the sum of its parts. We propose a new approach to ML/AI system design to foster human-machine mutual learning: synergistic interactions in which machines help people think critically and gain wisdom, while people help improve machine models by reframing ML tasks and immersing them in human-machine-human systems which provide feedback to the AI model while helping humans to learn. By explicitly aiming to increase human skill and wisdom, teaming goes beyond “human-in-the-loop” approaches where humans serve primarily to enhance machine performance. We contribute a conceptual model for human-machine teaming design and use a case study in radiology training to identify five critical considerations for interaction design and for how to make AI interactive: (1) human-machine dialogue (2) labelling and attention (3) problem framing (4) biases, values and affect (5) ethics, agency and human choice.Keywords
Funding Information
- Australian Research Council (DP200103582)
This publication has 42 references indexed in Scilit:
- LINDA-BN: An interpretable probabilistic approach for demystifying black-box predictive modelsDecision Support Systems, 2021
- International evaluation of an AI system for breast cancer screeningNature, 2020
- Human-Automation Teaming: Lessons Learned and Future Directions2018
- Use of Social Media in Radiology EducationJournal of the American College of Radiology, 2018
- Building DNN acoustic models for large vocabulary speech recognitionComputer Speech & Language, 2017
- Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided DetectionJAMA Internal Medicine, 2015
- Donald Schön, Herbert Simon and The Sciences of the ArtificialDesign Studies, 2009
- Influence of Computer-Aided Detection on Performance of Screening MammographyNew England Journal of Medicine, 2007
- The Construction of Shared Knowledge in Collaborative Problem Solving1995
- Improving Generalization with Active LearningMachine Learning, 1994